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Abstract 

The  purpose  of  this  research  is  to  develop  a  method  to  find  an  optimal  UAV  cyclic 
schedule  to  provide  maximum  coverage  over  a  target  area  to  support  an  ISR  mission.  The 
goal  is  to  reach  continuous  coverage.  UAV  continuous  coverage  of  a  target  area  is  crucial 
for  the  success  of  an  ISR  mission.  Even  the  smallest  coverage  gap  may  jeopardize  the 
success  of  the  mission.  Ideally  it  is  desirable  to  obtain  continuous  coverage  of  a  target 
area  but  the  stochastic  nature  of  the  problem  makes  continuous  coverage  without  gaps 
unlikely.  However,  it  is  still  possible  to  obtain  a  high  coverage  rate.  Coverage  gaps  may 
occur  at  handoff  from  one  UAV  to  another.  We  first  study  a  detenninistic  model  with 
identical  UAVs  and  obtain  the  minimum  number  of  required  UAVs  to  ensure  continuous 
coverage.  Continuous  coverage  is  possible  only  in  the  deterministic  setting.  The  model 
provides  valuable  insights  on  the  parameters  driving  the  UAV  perfonnance  coverage.  We 
show  that  the  loitering  and  the  roundtrip  times  are  the  most  impacting  parameters  driving 
the  performance  coverage  of  the  UAVs.  We  prove  that  the  number  of  UAVs  is  an 
increasing  function  of  the  roundtrip  time  and  a  decreasing  function  of  the  loitering  time. 
We  show  that  a  minimum  cyclic  scheduling  emerges  in  a  natural  way  when  the  fleet 
consists  of  identical  UAVs.  The  results  obtained  for  the  model  with  identical  UAVs  are 
then  extended  to  the  detenninistic  model  with  possibly  non-identical  UAVs.  Again 
because  it  is  a  detenninistic  model,  continuous  coverage  can  be  achieved.  Conditions  for 
continuous  coverage  are  obtained  and  used  to  formulate  the  scheduling  problem  as  an 
integer  linear  programming  model.  Special  cases  of  the  deterministic  model  are  also 


v 


studied  and  conditions  ensuring  continuous  coverage  are  given.  Similar  results  for  the 
stochastic  model  are  obtained.  The  stochastic  model  can  be  formulated  as  a  stochastic 
programming  model  with  probabilistic  constraints.  Also,  special  cases  are  studied  where 
the  UAV  attributes  have  specific  probability  distributions.  Results  obtained  can  be 
applied  to  other  surveillance  problems  and  particularly  those  pertinent  to  NRO  and  NSA. 
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THE  UAV  CONTINUOUS  COVERAGE 


PROBLEM 


Chapter  1 

I.  INTRODUCTION 

1.1  Setting 

In  the  past  two  decades,  conventional  warfare  has  shifted  towards  to  asymmetric  warfare 
as  witnessed  in  the  Iraqi  war.  Conventional  warfare  often  proves  to  be  ineffective  in  such 
situations  and  new  effective  strategies  to  fight  vigorously  the  enemy  in  these  new 
environments  and  realities  is  a  necessity.  In  particular,  developing  and  acquiring  an 
asymmetric  warfare  capability  is  regarded  as  an  important  tool  for  the  anned  forces  to 
fight  effectively.  In  the  asymmetric  warfare  framework,  adversaries  tend  to  use  basic  and 
rudimentary  but  nevertheless  effective  methods  that  conventional  warfare  technology 
does  not  know  how  to  counter.  It  is  inadequate  and  ineffective  to  fight  with  conventional 
weapons  an  enemy  that  uses  tactics  such  as  camouflage,  improvised  explosive  devices, 
suicide  bombings,  hiding  among  the  civilian  population,  hiding  in  rugged  terrains  hard  to 
access  and  so  on.  As  a  result,  there  is  a  definite  need  for  some  innovative  means  to  help 
the  war-fighter  fight  asymmetrically  and,  not  surprisingly,  it  is  here  that  the  Unmanned 
Aerial  Vehicle  (UAV)  comes  in  handy. 

The  Unmanned  Aerial  Vehicle  idea,  motivation,  and  development  have  a  long  history  but, 

for  our  purpose,  it  suffices  to  say  that  its  accelerated  development  and  deployment  were 

motivated  by  the  recent  need  to  be  an  effective  player  in  the  asymmetric  warfare  arena. 
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The  USAF  and  the  US  Department  of  Defense,  over  the  past  two  decades,  have  been 
using  UAVs  successfully  to  fight  back  by  aggressively  using  them  to  track  and  attack  the 
enemy.  It  turned  out,  as  attested  by  various  reports  pertinent  to  the  Iraq,  Bosnia,  Kosovo 
and  Afghanistan  wars  that  the  UAV  has  proved  itself  to  be  an  effective  and  lethal  tool  to 
combat  the  enemy.  It  is  no  surprise  that  the  US  Department  of  Defense  made  the  UAV  an 
integral  part  of  the  military  capabilities  and  has  dedicated  substantial  funds  to  support  its 
development  and  integration  into  National  Defense  (1:37,  2:26).  Various  branches  of  the 
military  use  the  UAV  as  an  ISR  tool  in  seeking  supremacy  over  the  adversary.  Homeland 
Security  also  uses  UAVs  as  a  valuable  tool  to  control  illegal  immigration  and  fight  drug 
trafficking. 

Using  UAVs  to  continuously  watch  the  enemy  and  acting  at  the  right  time  pays  off. 
Recently,  in  Iraq,  the  UAV  was  used  to  track  the  leader  of  Al-Queda  and  ultimately 
eliminate  him.  The  effective  tracking  was  the  result  of  carefully  watching  his 
whereabouts  for  600  hours  continuously  (3).  The  continuous  surveillance  and  coverage 
by  the  UAVs  was  the  key  for  the  success  of  the  operation.  Indeed,  were  it  not  for  the 
UAV  continuous  coverage  of  the  target,  the  enemy  could  have  easily  escaped  during  a 
UAV  coverage  gap  (i.e.,  surveillance  interruption)  thus  rendering  the  whole  tracking 
operation  a  failure.  It  is  therefore  easy  to  understand  why  UAV  continuous  coverage  is  so 
critical  for  the  success  of  crucial  ISR  missions. 

This  research  is  about  UAV  continuous  coverage  and  surveillance  optimization.  More 
specifically,  it  is  about  optimally  scheduling  UAVs  cyclically  to  carry  out  a  critical  ISR 
mission  that  requires  continuous  coverage  of  the  target  area.  The  motivation  is  to  provide 
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surveillance  without  interruption  because  the  purpose  of  the  mission  depends  on  it.  The 
ultimate  goal  is  to  provide  a  continuous  flow  of  information  and  data  to  support  the  war¬ 
fighter  on  the  ground,  to  enhance  the  global  efforts  on  fighting  terrorism,  and  to  improve 
the  asymmetric  warfare  capabilities  of  the  anned  forces. 


1.2  Problem  Statement 

A  critical  ISR  mission  requiring  continuous  surveillance  and  coverage  of  a  target  area  is 
to  be  accomplished  using  UAVs  as  the  main  resource.  A  UAV  fleet  is  available  at  the 
operating  base  to  support  the  mission.  Because  the  UAV  is  a  valuable  and  scare  resource 
it  has  to  be  used  parsimoniously  particularly  when  there  are  other  ISR  missions  to  be 
conducted  at  other  sites  around  the  world  as  it  is  often  the  case.  The  manager  responsible 
for  the  mission  needs  to  assemble  a  team  of  UAVs  to  carry  out  the  mission.  The  main 
questions  that  need  to  be  answered  are  how  to  sequence  the  UAVs  to  conduct  the  mission 
to  provide  continuous  coverage  of  the  target  area  and  how  many  UAVs  are  needed 
knowing  that  one  should  not  use  more  UAVs  than  needed.  In  short  the  manager  is  faced 
with  a  scheduling  optimization  problem  where  he  seeks  to  find  the  best  UAV  cyclic 
schedule  to  provide  coverage  without  interruption  of  the  mission  because  the  success  of 
the  mission  depends  on  it.  The  manager  needs  help  to  answer  his  questions  in  a  general 
setting  and  is  particularly  interested  in  developing  a  mathematical  model  to  derive 
structural  results  and  insights  to  guide  his  decision  making  process  and  it  is  not  so  much 
interested  in  simulation  at  this  point.  The  manager  stresses  that  continuous  coverage  is  a 
key  requirement.  Ideally,  if  possible,  he  would  like  to  see  no  coverage  gaps  at  all  since 
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that  may  render  the  mission  worthless;  for  example,  objects  of  interest  may  move  out  of 
the  target  area  without  him  being  aware  of  it.  The  manager  realizes  that  there  could  be 
several  unforeseen  events  that  could  prevent  continuous  coverage  and  if  it  is  the  case  then 
he  wants  to  obtain  the  maximum  coverage  possible. 

The  manager’s  problem  which  is  simply  stated  as  the  UAV  continuous  coverage  problem 
is  the  main  focus  of  this  thesis.  More  specifically,  the  purpose  of  this  thesis  is  to  develop 
a  UAV  continuous  coverage  scheduling  optimization  model  to  help  the  manager  figure 
out  how  to  come  up  with  an  optimal  UAV  cyclic  schedule  that  provides  continuous 
coverage  of  the  target. 


1.3  Objective 

The  goal  of  this  research  is  to  establish  a  mathematical  modeling  foundation  for  the  UAV 
scheduling  and  coverage  problems.  A  mathematical  baseline  structure  is  needed  so  that 
further  research  will  build  on  it  to  tackle  more  complex  UAV  scheduling  and  coverage 
problems.  This  research  is  a  first  step  toward  achieving  that.  It  does  not  lean  much  on 
previous  work  since  the  basic  ideas  and  approach  are  new.  The  UAV  continuous 
coverage  problem  is  indeed  complex.  Here  we  simplify  the  problem  so  that  the 
understanding  and  insights  we  gain  from  the  basic  version  of  the  problem  can  be 
extended  to  more  complex  versions.  The  main  tasks  to  be  competed  are: 

1 .  Develop  an  adequate  mathematical  framework  for  the  UAV  continuous  coverage 
problem  by  starting  with  a  very  basic  version  of  the  problem. 
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2.  Develop  a  deterministic  model  for  a  homogenous  fleet  of  UAVs  and  derive 
necessary  and  sufficient  conditions  for  the  optimality  of  cyclic  schedule. 

3.  Develop  a  deterministic  model  for  non-homo genous  fleet  of  UAVs  and  derive  a 
method  that  finds  an  optimal  cyclic  schedule. 

4.  Derive  a  stochastic  programming  approach  to  find  an  optimal  cyclic  scheduling 
when  some  of  the  UAV  basic  data  is  stochastic. 


1.4  Scope 

This  research  is  the  first  of  its  kind.  To  the  best  of  our  knowledge,  the  mathematical 
model  developed  in  this  thesis  is  introduced  here  for  the  first  time.  The  continuous 
coverage  model  developed  in  this  work  can  be  applied  to  other  situations  where  a  task  is 
to  be  processed  continuously  without  interruptions  and  the  “agents”  providing  the 
resources  to  perform  the  task  are  scheduled  cyclically.  Each  agent  carries  out  a  portion  of 
the  task  before  handing  it  over  to  the  next  one.  Here  the  agent  is  limited  in  its  capability 
to  work  for  a  long  time  without  interruption  because  it  needs  resources  to  sustain  itself 
while  working  and  so  needs  to  break  away  from  the  task  while  another  agent  takes  over. 
Therefore,  an  important  characteristic  of  the  task  to  be  executed  (processed)  is  that  only 
one  agent  can  work  on  the  task  at  a  time.  In  other  words,  because  of  the  nature  of  the  task 
at  hand,  the  agents  are  not  allowed  to  work  concurrently.  Search  and  rescue  missions 
where  continuous  coverage  may  be  crucial  to  find  survivors,  aerial  tankers  needing  to 
orbit  while  waiting  to  refuel  aircraft,  satellite  orbiting  to  provide  a  continuous  flow  of 
infonnation  may  be  modeled  using  the  results  of  this  thesis.  We  anticipate  that  the 
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present  work  may  serve  as  a  baseline  for  further  work  in  UAV  scheduling  and  continuous 


coverage. 


1.5  Overview 

Chapter  2  presents  the  mathematical  setting  and  the  basic  definitions  needed  for  modeling 
the  UAV  continuous  coverage  problem  and  then  proceeds  to  study  a  simple  version  of  the 
problem.  The  first  model  referred  to  as  the  basic  model  studies  the  UAV  continuous 
coverage  problem  where  the  operational  UAV  fleet  is  homogenous  in  the  sense  that  all 
the  UAVs  are  identical.  The  main  ideas,  insights,  and  approach  from  this  basic  model 
will  be  the  foundation  for  studying  more  complex  versions  of  the  basic  model.  In  fact, 
this  approach  of  first  studying  a  simple  version  of  a  scheduling  problem  and  then 
extending  the  insights  to  more  complex  problems  has  been  used  quite  often  in  scheduling 
theory.  The  main  results  we  derive  for  the  basic  model  are  necessary  and  sufficient 
conditions  that  characterize  the  optimal  cyclic  schedule.  Also,  we  derive  monotonicity 
properties  to  show  how  the  optimal  number  of  UAVs  depends  on  the  UAV  attributes. 
Next,  in  Chapter  3,  we  extend  the  results  of  Chapter  2  to  the  case  of  a  non-homogenous 
fleet  of  operational  UAVs  where  the  UAVs  are  not  necessarily  identical  with  respect  to 
their  attributes.  Here  the  model  is  a  more  complex  combinatorial  optimization  problem 
which  we  formulate  as  a  binary  integer  linear  programming.  This  problem  is 
computationally  NP  hard  and  therefore  does  not  have  an  efficient  algorithmic  solution 
when  the  size  of  the  UAV  fleet  is  very  large  (4:13,  34).  However,  for  small  size  problems 
traditional  techniques  such  as  branch  and  bound  methods  can  be  used  for  numerical 
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applications.  With  the  intent  of  solving  large  scale  UAV  coverage  models  we  introduce 
the  notion  of  a  minimal  cyclic  schedule.  The  concept  of  a  minimal  cyclic  schedule  can  be 
used  in  a  Tabu  search  procedure  for  example  because  non-minimal  cyclic  schedules  are 
not  optimal  and  therefore  can  be  excluded  from  the  search.  Since  the  problem  is  NP  hard, 
heuristics  can  be  used  to  find  good  solutions  for  large  scale  models.  Finally  the  model  is 
extended  to  the  case  where  some  UAV  attributes  are  stochastic.  Here  the  problem  is 
formulated  as  a  stochastic  program  because  an  imperfect  handoff  may  occur  with  a 
positive  probability.  The  models  have  also  been  extended  to  account  for  an  admissible 
coverage  gap  of  some  length  deemed  not  to  affect  the  mission  objective. 
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Chapter  2 

II.  THE  MODEL  FOR  A  HOMOGENEOUS  UA  V FLEET 

2.1  Introduction 

The  UAV  continuous  coverage  model  introduced  in  this  thesis  is  new  and  does  not  lean 
much  on  previous  research  because  no  modeling  work  has  been  done  on  UAV  continuous 
coverage  in  the  same  spirit  it  is  done  here.  There  is  a  vast  amount  of  research  done  on 
UAVs  but  very  little  is  directly  related  to  the  present  work.  Related  UAV  studies  have 
appeared  in  the  area  of  UAV  decision  and  control  (5),  UAV  swarms  (6,  7,  8),  and  UAV 
simulation  (9)  but  these  studies  do  not  have  any  direct  impact  on  the  continuous  coverage 
problem  approach  as  it  is  conceived  here.  However,  for  a  general  background  the 
references  that  the  reader  will  find  very  useful  are  Fahlstrom  and  Gleason  (10),  Howard 
(11),  Renehan  (12),  Longino  (13),  Kennedy  (14)  and  Stephenson  (15).  Other  US 
Government  documents  and  reports  which  are  helpful  for  a  basic  understanding  of  UAVs 
are  (1,  2,  16,  17). 

A  UAV  system  consists  of  several  components  such  as  the  ground  control  station,  launch 
and  recovery,  payload,  data  links  etc.  However,  we  simply  focus  on  the  air  vehicle  part 
which  we  refer  to  as  the  UAV.  Hence  for  the  purpose  of  the  study  the  UAV  is  just  a 
flying  object.  One  very  important  aspect  of  the  UAV  though  is  its  flight  trajectory  which 
plays  a  major  role  in  the  search  for  the  best  cyclic  schedule.  In  an  ISR  mission  a  UAV 
will  be  commuting  between  the  operating  base  and  the  target  area  to  support  the  mission. 
Moving  the  UAV  back  and  forth  between  the  operating  base  and  the  target  area  may  be 


regarded  as  a  supporting  activity  whereas  loitering  is  the  core  task  (activity).  Generally 
then  the  performance  of  the  UAV  will  be  based  on  how  much  support  is  provided  to  the 
core  task.  For  the  same  loitering  time  the  less  support  provided  the  better.  An  idea  of 
productivity  based  of  the  ratio  of  support  to  core  expenses  will  be  reflected  in  the  result 
that  we  derive. 


Source:  Extracted  from  the  Air  Combat  Command,  Endurance  Unmanned  Aenal  Vehicles  Concept  of 
Operations,  3  December  1996-version  2. 

Figure  1.  The  UAV  Flight  Trajectory 


Although  the  trajectory  of  the  UAV  during  an  ISR  mission  can  be  complex  (see  Figure  1) 


we  simplify  it  to  a  few  phases.  The  UAV  starts  from  a  mission  ready  state  at  the 


operating  base,  flies  to  the  target  area,  loiters  for  a  pre-specified  length  of  time,  then 


hands  over  the  mission  to  the  next  scheduled  UAV  and  heads  back  to  the  operating  base. 


The  UAV  periodically  goes  back  to  the  target  area  to  provide  coverage.  Because  the 


UAV  has  a  limited  endurance  time,  it  cannot  loiter  indefinitely  over  the  target  area  and 


thus  needs  to  break  away  from  the  orbiting  task.  A  UAV  ending  its  loitering  tour  returns 


to  the  operating  base  for  refueling,  inspection,  and  maintenance.  In  fact,  refueling  is  the 


major  reason  the  UAV  returns  to  the  operating  base.  We  assume  all  along  that  the 


mission  length  is  longer  than  a  UAV  endurance  time  so  that  more  than  one  UAV  are 
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needed  to  provide  continuous  coverage  since  obviously  one  UAV  alone  cannot  provide 
continuous  coverage.  Therefore,  several  UAVs  need  to  work  collaboratively  as  a  team  to 
successfully  accomplish  a  critical  ISR  mission  requiring  continuous  coverage  by  relaying 
each  other  cyclically. 

The  goal  is  to  build  the  best  UAV  cyclic  schedule  to  provide  continuous  coverage  of  a 
target  area.  A  UAV  cyclic  schedule  consists  of  a  finite  number  of  UAVs  scheduled 
sequentially  (serially)  to  provide  continuous  coverage.  In  a  cyclic  schedule,  each  UAV 
provides  coverage  periodically.  The  objective  is  to  provide  coverage  without 
interruptions  with  a  minimum  number  of  UAVs  or  equivalently  to  find  the  optimal  cyclic 
schedule  that  provides  coverage  with  no  gaps  of  the  target  area.  The  concept  of  cyclic 
scheduling  (18,  19,  20,  21,  22)  has  been  used  in  a  production  environment  but  the  UAV 
continuous  coverage  problem  cannot  be  cast  within  those  standard  frameworks  of 
scheduling  theory  because  the  present  objective  may  not  have  a  meaningful  interpretation 
in  a  production  environment. 

In  this  chapter  we  study  a  deterministic  UAV  continuous  coverage  model  with  identical 
UAVs.  The  model  is  referred  to  as  the  basic  model. 


2.2  Preliminaries  and  Basic  Definitions 

The  following  definitions  will  be  used  throughout  this  thesis.  A  few  of  them  will  be  made 
mathematically  more  precise  as  the  work  progresses.  Formally,  a  target  area  (area  of 
responsibility)  is  the  area  where  the  UAV  conducts  a  surveillance  mission.  A  UAV 
roundtrip  is  the  time  it  takes  the  UAV  to  fly  from  the  operating  base  to  the  target  area  and 
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back.  This  includes  the  time  spent  in  maintenance,  refueling  and  inspection.  The 
endurance  of  a  UAV  is  the  maximum  duration  the  UAV  can  sustain  itself  flying.  It 
depends  on  several  factors  such  the  amount  of  fuel  it  carries,  the  weight  of  the  payload, 
weather  conditions,  enemy  hostility,  etc.  A  coverage  sap  (interruption)  occurs  when  the 
target  area  is  left  unwatched  for  some  time  however  short  that  may  be.  Levels  of 
coverage  gaps  and  their  severities  may  also  be  defined  when  the  analysis  calls  for  it.  The 
coverage  of  a  target  area  is  said  to  be  continuous  or  uninterrupted  if  no  coverage  gap 
(interruption)  occurs  during  the  mission.  A  UAV  is  said  to  be  operationally  ( mission ) 
ready  at  time  t  if  at  time  t  it  can  take  over  the  surveillance  mission  from  another  UAV 
and  start  loitering  over  the  target  area  at  time  t.  A  perfect  handoff  occurs  when  a  UAV 
hands  over  the  mission  to  the  next  UAV  with  no  coverage  gap.  An  imperfect  handoff 
occurs  when  there  is  a  coverage  gap  at  the  time  of  handoff.  We  say  that  a  UAV  takes 
over  the  mission  successfully  from  the  active  and  departing  UAV  if  no  coverage  gap  is 
induced  at  handoff.  The  loitering  ( loiter )  time  is  the  time  the  UAV  spends  orbiting  over 
the  target  area  collecting  intelligence  data.  A  UAV  schedule  is  feasible  if  it  does  not 
cause  coverage  gaps  during  the  mission.  The  slack  time  of  a  UAV  is  the  time  between  the 
time  UAV  is  mission  ready  to  the  time  it  is  deployed  to  the  target  area. 

To  each  UAV,  we  assign  two  attributes.  The  first  one  is  the  roundtrip  time  and  the 
second  one  the  loitering  time.  Let  the  fleet  with  K  UAVs  be  represented  by  a  finite 
set  F  —  {(A1,7’1),  (A2,T2),  ...,^,7^)}=  {Vlt  V2 , ...  ,  VK)  where  Vt  =  (A;,  7))  is  the 
attribute  vector  of  UAV;.  The  time  At  is  the  roundtrip  time  and  7)  the  loitering  time  of 
UAV;.  The  roundtrip  time  A(  is  the  aggregation  of  three  components.  It  is  the  sum  of 
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three  variables  f2  and  c3  where  is  the  trip  duration  from  the  operating  base  to 
the  target  area,  ^  the  trip  duration  from  the  target  area  to  the  operating  base,  and  the 
duration  spent  in  maintenance  and  repair  at  the  operating  base. 

Definition  2.2.1  Let  the  precedence  symbol -A”  be  the  “ mission  handoff”  symbol 
where  we  write  -»  Vj  to  mean  that  UAVj  hands  over  the  mission  to  UAVj. 

S 

Definition  2.2.2  Let  the  precedence  symbol  ”  be  the  “successful  mission  handoff” 

S 

symbol  where  we  write  Vi~*Vj  to  mean  that  UAVj  hands  over  the  mission  to  UAVj 
successfully. 

Definition  2.2.3  The  ordered  sequence  of  UAVs  E  =  {VLi,Vi2 . Vik)  with  Vh  = 

Tt^j ,  j  —  1,2, ... ,  k  is  said  to  cyclic  schedule  if: 

(a)  Vh  -  -  -  -  V.  -  Vik 

(b)  Vik  ->  Vh 

A  schedule  is  said  to  be  of  size  6  if  it  uses  6  UAVs.  Figure  2  shows  a  graphical 
representation  of  a  cyclic  schedule  with  6  UAVs  as  a  circuit  with  6  nodes  with  one  for 
each  UAV. 
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Figure  2.  Cyclic  Schedule  with  6  UAVs 

Each  oriented  arc  symbolizes  a  mission  handoff  from  one  UAV  to  the  next.  The  way  this 
schedule  of  size  6  works  is  straightforward.  First  UAVi  flies  to  the  target  area  to  loiter  for 
a  duration  equal  to  Tx  and  heads  back  to  the  operating  base.  UAV2,  which  is  supposed  to 
be  at  the  target  area  when  UAV  1  is  about  to  be  done,  takes  over  the  mission  and  begin  its 
loitering  task  which  lasts  T2.  Then  the  same  happen  between  UAV2  and  UAV3  etc.  When 
UAV6  finishes  its  share  of  loitering  it  hands  over  the  mission  to  the  very  first  UAVi  and  a 
scheduling  cycle  has  been  accomplished.  The  next  cycle  is  similar  to  the  previous  one. 
Note  that  a  UAV  is  used  only  once  during  a  scheduling  cycle  and  there  is  only  one 
loitering  UAV  over  the  target  area.  A  cyclic  schedule  gives  each  UAV  a  certain  “rest” 
time  away  from  the  target  area.  This  rest  period  consists  mainly  in  refueling  and 
undergoing  the  necessary  maintenance  and  inspection  to  get  the  UAV  in  “top  shape” 
again  for  its  next  loitering  tour. 
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2.3  The  Basic  Model 


The  UAV  model  with  a  homogeneous  fleet  of  identical  UAVs  is  referred  to  as  the  basic 
model.  In  this  basic  model,  the  roundtrip  and  loitering  times  of  the  UAVs  are  all  equal  to 
(A,  T )  and  the  UAV  fleet  can  be  written  as  F  =  {(A,  T),  (A,  T), ... ,  (A,  T )}  with  \F\  =  K. 
Note  that  we  are  dropping  the  subscript  when  writing  the  attributes  of  a  UAV.  Define  the 
following  variables  h,  d,  T,  and  A  as  being  respectively  the  loitering  altitude  over  the 
target  area,  the  distance  between  the  operating  base  and  the  target  area,  the  loitering  time, 
and  the  roundtrip  time  of  the  UAV.  Recall  that  A=  +  <f2  +  £3  . 


Target 


Figure  3  shows  the  main  elements  of  the  basic  model.  It  shows  the  flight  trajectory  of  the 
UAV  flying  up  to  the  target  area  and  back.  The  roundtrip  and  loitering  times  (A  and  T 
respectively)  of  a  UAV  clearly  depend  on  the  distance  d  and  loitering  altitude  h. 

To  illustrate  the  main  idea  of  when  a  cyclic  schedules  may  generate  coverage  gaps  we 
consider  two  specific  cyclic  schedules  where  the  first  one  does  not  generate  coverage 
gaps  whereas  the  second  one  does.  Basically  is  is  about  comparing  the  roundtrip  time  of  a 
UAV  to  the  aggregated  loitering  times  of  the  other  UAVs  of  the  cyclic  schedule. 
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Let  us  start  with  a  cyclic  schedule  that  does  not  induce  coverage  gaps.  As  mentioned 
earlier  such  a  schedule  should  consists  of  at  least  two  UAVs.  More  specifically,  consider 
a  cyclic  schedule  consisting  of  two  identical  UAVs  with  the  following  parameters: 

7  =  8  hours, 

^  =  2  hours, 

<f2  =  2  hours,  and 
<f3  =  4  hours. 

Figure  4  shows  these  two  UAVs  working  together  in  such  a  perfect  unison  that  they  do 
not  cause  coverage  gaps. 


coverage 

100% 

0% 


UAVi 


UAV2  UAVi  UAV2  UAVi 


10  12  14  16  18  20  22  24  26  28  30  32  34  36  38  40  42  44 


UAVi 


UAV2 


Figure  4.  Two-UAV  Cyclic  Schedule  with  no  Coverage  Gap 
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The  reason  that  this  size  2  cyclic  schedule  is  free  of  coverage  gaps  is  as  follows.  At  time 
2  UAVi  starts  its  loitering  tour  over  the  target  area  and  at  time  10  finishes  its  loitering 
tour  and  needs  to  leave  the  target  area.  In  the  first  cycle,  it  is  clear  that  UAV2  can  take 
over  the  mission  successfully.  At  time  10  a  perfect  handoff  occurs  smoothly  from  UAVi 
to  UAV2.  We  assume  that  the  handoff  process  is  perfect  and  takes  a  negligible  length  of 
time.  That  is,  as  UAVi  moves  out  of  the  target  area  UAV2  moves  in.  Next,  at  time  18 
UAV2  finishes  its  loitering  task  and  needs  to  leave  the  target  area.  At  that  time  UAVi  can 
take  over  the  mission  successfully  from  the  UAV2  because  the  roundtrip  time  of  UAVi  is 
the  same  as  the  loitering  time  of  UAV2  which  means  that  while  UAV2  loiters  over  the 
target  area  UAV 1  is  capable  of  flying  to  the  operating  base  and  back  to  the  target  area.  As 
a  result,  a  perfect  handoff  from  UAV2  to  UAVi  takes  place.  Clearly  in  order  to  avoid  a 
coverage  gap  the  roundtrip  time  of  UAV  1  needs  to  be  smaller  than  the  loitering  time  of 
UAV2  and  similarly  the  roundtrip  time  of  UAV2  needs  to  be  smaller  than  the  loitering 
time  of  UAVi.  But  UAVi  and  UAV2  being  identical  have  the  same  loitering  and 
roundtrip  times  and  therefore  to  avoid  coverage  gaps  we  must  have: 

<fi  +  <f2  +  <f3  <  T. 

Let  us  consider  another  cyclic  schedule  scenario  with  a  farther  target  area  having  the 
following  parameters: 

7  =  8  hours, 

(fi  =  6  hours, 

^2  =  6  hours,  and 
^3  =  2  hours. 
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Figure  5.  Two-UAV  Cyclic  Schedule  with  a  Coverage  Gap 


Figure  5  shows  how  the  schedule  dynamically  unfolds.  It  is  clear  that  <fi  +  ^2  +  ^3  >  T. 
As  a  result,  a  coverage  gap  is  generated  by  this  cyclic  schedule.  Figure  5  can  help 
understand  why  such  a  schedule  causes  a  coverage  gap.  By  the  time  UAV2  finishes  its 
loitering  tour  UAVi  has  not  been  able  to  reach  to  target  area  because  of  the  length  of  its 
roundtrip  time  A  and,  as  a  result,  a  coverage  gap  occurs  during  the  switch  from  UAV2  to 
UAVi.  Thus,  to  avoid  coverage  gaps  one  additional  UAV  at  least  is  needed.  Let  us  add 
one  more  UAV  to  have  a  schedule  with  three  identical  UAVs  and  the  same  performance 
parameters  as  earlier.  This  time  in  order  to  show  how  this  new  size  3  cyclic  schedule 
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unfolds  we  use  a  Gantt  chart  because  it  is  more  effective  and  easy  to  read.  Figure  6 
depicts  the  cyclic  schedule  with  3  UAVs  as  a  Gantt  chart. 
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Figure  6.  Three-UAVs  Cyclic  Schedule  with  no  Coverage  Gap 


By  time  24  all  three  UAVs  have  loitered  once.  At  time  24  when  UAV3  is  done  with  its 
loitering  task  we  check  whether  one  of  UAVi  or  UAVt  is  able  to  take  over  the  mission 
without  causing  a  coverage  gap.  Clearly  UAV2  cannot  assure  that  since  time  24  falls 
into  its  shaded  area  which  represents  its  unavailability  time  (roundtrip  time)  period; 
however,  UAVi  is  available  at  time  24.  Consequently,  in  order  for  UAVi  to  be  able  to 
take  over  the  mission  successfully  from  UAV3  it  must  that  its  roundtrip  time  should  not 
last  longer  than  the  aggregated  loitering  times  of  UAV2  and  UAV3.  This  means  that 
UAVi  should  be  able  to  return  to  the  target  area  before  UAV2  and  UAV3  are  done  with 
their  loitering  tasks.  Thus  to  obtain  continuous  coverage  we  must  have: 


<fi  +  ^2  +  ^3  ^  2T. 

Since  the  three  UAVs  are  identical  this  inequality  holds  for  all  of  them.  Next,  consider  a 
new  target  area  which  is  farther  from  the  operating  base  than  the  previous  one  and  with 
the  following  parameters: 
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T  —  7  hours, 

=  7  hours, 

<f2  =  7  hours,  and 
<f3  =  2  hours. 

Here,  the  previous  inequality  which  led  to  continuous  coverage  does  not  hold  anymore 
because  2  x  T  —  14  is  smaller  than  <fi  +  ^2  +  ^3  —  16  and  so  this  schedule  will  cause 
coverage  gaps.  Therefore,  at  least  one  additional  UAV  is  needed  for  this  schedule  to  have 
the  potential  to  provide  continuous  coverage. 

We  have  analyzed  a  few  specific  cyclic  scheduling  scenarios  to  find  out  the  reasons  a 
schedule  may  or  may  not  provide  continuous  coverage.  An  idea  that  plays  a  major  role  is 
whether  or  not  a  departing  UAV  from  the  target  area  can  be  back  to  the  area  before  the 
other  UAVs  of  the  cyclic  schedule  have  each  done  their  share  of  loitering.  The  results  of 
this  section  are  based  on  that  idea. 

2.4  Results 

The  first  main  result  for  the  model  with  identical  UAVs  is  a  necessary  and  sufficient 
condition  that  characterizes  the  optimal  cyclic  schedule.  The  result  provides  a  formula  for 
the  minimum  number  of  identical  UAVs  required  to  support  a  mission  with  continuous 
coverage.  Two  more  monotonicity  properties  show  how  coverage  depends  on  the 
roundtrip  and  loitering  times.  More  specifically,  if  T  is  kept  constant  and  <fx  +  <f2  +  <f3 
increases  (decreases)  then  the  minimum  number  of  UAVs  needed  for  continuous 
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coverage  increases  (decreases).  Also,  as  the  loitering  time  7  increases  (decreases)  the 
minimum  number  of  UAVs  decreases  (increases). 

2.4.1  Main  Result 

Theorem  2.4.1  Let  the  positive  integer  N  >  2  be  such  that 

(N  —  2)7  <  A  <  (N  —  1  )7. 

Then,  a  schedule  with  N  UAVs  ensures  a  continuous  coverage.  However,  a  schedule 
with  N  —  1  or  less  UA  Vs  causes  a  coverage  gap  during  the  mission. 

Proof.  We  need  at  least  2  UAVs  to  obtain  continuous  coverage,  and  thus  N  >2.  We 
proceed  to  prove  the  assertion  of  the  theorem  by  induction.  First,  we  show  the  result  for 
N  —  2.  Assume  that 

0<A  <7  (2.4.1) 

where,  we  recall  that  A  =  ^  +  t;2  +  <f3.  We  show  that  with  exactly  N  =  2  UAVs  the 
mission  can  be  accomplished  with  no  coverage  gap.  The  following  chart  shows  a  cyclic 
schedule  with  2  identical  UAVs. 

UAVi:  1 - -  H//////////////| - 1- - -|//////////////| - >  time 

0  T  T+A  2T  3T  3T+A 

UAV2:  | - 1 - 1//////////////| - 1 - 1/////////////|— >  time 

0  T  2T  2T+A  3T  4T 

Figure  7.  Cyclic  Schedule  with  2  UAVs 

Note  that  the  scheduling  cycles  are  [0,27],  [27,47],  •••.  UAVi  loiters  from  time  zero 

until  time  7  whereas  UAV2  does  it  from  time  7  to  27.  At  time  27  when  UAV2  is 
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done  with  its  ISR  tour,  UAV  i  can  take  over  the  surveillance  with  no  coverage  gap  if  and 
only  if  UAVi  is  available  at  time  2 7.  But  UAVi  is  available  the  earliest  at  time  7  +  A. 
Thus  UAV2  can  take  over  the  mission  successfully  if  and  only  if 

7  +  A  <  2T 


or,  equivalently 


0  <  A  <7 


which  is  exactly  condition  (2.4.1).  Next,  let  UAVi  take  over  the  mission  at  time  27 
and  loiter  from  time  2 7  to  37.  Now  we  check  whether  UAV2  can  take  over  the  mission 
successfully  from  UAVi.  The  answer  is  affirmative  because  the  inequality  27  +  A  <  37 
is  equivalent  to  A  <  7.  UAV2  will  loiter  in  [37,47]  and  at  time  47  UAVi  takes  over. 
Then  a  new  identical  cycle  starts  all  over  again.  Therefore,  the  theorem  is  proved  when 
N  —  2.  Next,  we  show  that  the  theorem  is  true  when  N  —  3.  Assume  that  7  <  j  + 
^2  +  &  <  27  or 

7  <  A  <  27.  (2.4.2) 

First,  7  <  A  implies  that  condition  (2.4.1)  is  violated  and  consequently  we  need  more 
than  two  UAVs  to  ensure  continuous  coverage.  We  show  that  we  need  exactly  3  UAVs. 
With  3  UAVs  we  have  the  following  (Gantt)  chart: 
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UAVj: 


|////////////////| - 1 - 1////////////////| - S' - — I— >  time 

0  T  T+A  3T  4T  4T+A  6T  7T 

UAV2:  | - j— - _|////////////////| - !— - 1////////////////| - >  time 

0  T  2T  2T+  A  4T  5T  5T+A 

UAV3:  | - 1 - i - 1////////////////| - 1- - - — > | ///////////////// 1 - >  time 

0  T  2T  3T  3T+  A  5T  6T  6T+A 

Figure  8.  Cyclic  Schedule  with  3  UAVs 

Note  that  the  scheduling  cycles  are  [0,37],  [37,67],  and  we  have  the  following 
sequence  of  events: 

UAVi:  Loiters  from  time  0  to  time  7  and  is  operationally  ready  the  earliest  at  time 
7  + A. 

UAV2:  Loiters  from  time  7  to  time  27  and  is  operationally  ready  the  earliest  at  time 
27  + A. 

UAV3:  Loiters  from  time  27  to  time  37  and  is  operationally  ready  the  earliest  at  time 
37  + A. 


When  UAV3  completes  its  surveillance  tour  at  time  37,  either  UAV2  or  UAVi  takes 
over.  Notice  that  UAV2  cannot  take  over  without  causing  a  coverage  gap  because  it  is  not 
operationally  ready  at  that  time.  In  fact,  UAV2  is  operationally  available  the  earliest  at 
time  27  +  A  and  thus  UAV2  can  take  over  from  UAV3  with  no  coverage  gap  if  and  only 
if 


27  +  A  <  37 
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or 

A<  7 

However,  we  know  that  A  >  7  from  (2.4.2).  As  a  result,  UAV2  cannot  ensure 
continuous  coverage.  It  remains  to  check  that  UAVi  can  take  over  the  mission  from 
UAV3  without  a  coverage  interruption.  The  question  is  whether  UAVi  is  available  at  time 
3T  when  UAV3  is  done  with  its  tour.  In  fact  since  UAVi  is  available  at  time  T  +  A,  it 
can  take  over  successfully  if  and  only  if 

7  +  A<  37 
or 

A<  2 7 

But,  this  last  inequality  is  part  of  (2.4.2)  and  thus  UAVi  can  take  over  successfully.  Now 
assume  that  UAVi  takes  over  the  mission  and  let  it  loiter  in  the  time  interval  [37,47]. 
Then,  at  time  47  when  UAVi  is  done  with  its  tour  we  check  which  of  UAV2  and  UAV3 
can  take  over  successfully.  In  fact  UAV2  can  take  over  since  27  +  A  <  47  is  equivalent 
to  A  <  27.  However,  UAV3  cannot  take  over  the  surveillance  from  UAVi  because 
37  +  A  <  47  being  equivalent  to  A  <  7  contradicts  A  >  7.  Now  let  UAV2  take  over 
and  loiter  in  [47,57],  A  similar  argument  shows  that  only  UAV3  can  take  over  the 
mission  successfully  from  UAV2  at  time  57.  Thus,  let  UAV3  loiter  in  [57,67]. 
Similarly,  at  time  67,  only  UAVi  can  take  over  the  mission  from  UAV3  with  no 
coverage  gap.  Then  another  identical  cycle  starts  all  over  again  at  time  67  and  thus  the 
theorem  is  proved  for  N  —  3.  In  fact,  for  N  —  3  UAVs  we  have  shown  that  we  have  a 
feasible  UAV  schedule  (see  Figure  9)  with  three  UAVs. 
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Figure  9.  Cyclic  Schedule  of  Size  3 

Next,  we  show  the  theorem  is  true  for  any  IV  >  2.  For  that,  we  assume  the  theorem  is 
true  up  to  N  —  1  and  prove  that  it  is  true  for  N.  Assume  that 

(A  -  2)T  <  A  <  (IV  —  1)7.  (2.4.3) 

Since  (IV  —  2)7  <  A,  then  A  does  not  belong  to  any  of  the  intervals 

[0,7],  [7,  27] . [(TV  -  3)7,  (JV  -  2)7] 

and  thus  by  the  induction  assumption  the  number  of  required  UAVs  must  be  larger  than 
or  equal  to  N  to  ensure  continuous  coverage.  We  show  that  exactly  N  UAVs  are 
required.  Note  that  the  scheduling  cycles  are  [0, TVT] ,  [ATT,  2A/T],  ...  and  the  following 
events  take  place: 

UAVi:  Loiters  from  time  0  to  time  7  and  is  operationally  ready  the  earliest  at  time 
7  + A. 

UAV2  :  Loiters  from  time  7  to  time  27  and  is  operationally  ready  the  earliest  at  time 
27  + A. 

UAV3  :  Loiters  from  time  27  to  time  37  and  is  operationally  ready  the  earliest  at  time 
37  + A. 
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UAVn_i  :  Loiters  from  (/V  —  2)T  to  time  (N  —  1)T  and  is  operationally  ready  the 
earliest  at  time  (IV  —  1)T  +  A. 

UAVn  :  Loiters  from  (N  —  1)T  to  time  NT  and  is  operationally  ready  the  earliest  at 
time  NT  +  A. 


These  are  shown  in  Figure  10. 

UAVj :  j - —|  /////////////////////////// . .  .111111  HI llll  | - !■ 


o  7  I  7+A  I 

i  i 

UAV2:  | - ■  —  //////////////. .  .llllllll}lllllllllltillllll\—\ - 

0  7  IT  I! 

UAV3:  | - 1 - 1 - 1 III. .  .Illllll}[lllllllll\llllllllllllllllll\ 

0  7  27  37  l  i 


■>  time 


■>  time 


■>  time 


uavn.i:  I - 1 - 1 - 1—... - \llllllllll\llllllllllllllllllllllllllllllllllllllll  - >  time 

0  7  27  37  [  ) 

UAVn:  | - 1 - 1 - 1—...- - -I— -]j  ////////////////////////////////////////// — >  time 

0  7  27  37  (N-l)T  NT 


Figure  10.  Cyclic  Schedule  with  ^Identical  UAVs 

UAVn  completes  its  first  loitering  at  time  NT.  We  show  that  at  least  one  UAV  from  the 
collection  {UAVi,  UAV2,  ...  ,  UAVn_i}  can  take  over  the  mission  without  causing  a 
coverage  gap.  In  fact,  we  show  that  UAVi  is  the  only  UAV  available  to  take  over  the 
surveillance  from  UAVN  without  causing  a  coverage  interruption.  First,  UAV2  is 
operationally  ready  the  earliest  at  time  2T  +  A  and  can  take  over  with  no  coverage  gap 
if  and  only  if  2T  +  A  <  NT,  or 

A  <  (TV  -  2)T 
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But  we  know  that  A  >  (A  —  2)7  and,  as  a  result,  UAV2  cannot  successfully  take  over 
the  mission  from  UAVn.  Next,  we  show  that  UAV3  cannot  either.  Indeed  UAV3  is 
available  the  earliest  at  time  37  +  A  and  therefore  can  take  over  with  no  coverage  gap  if 
and  only  if  37  +  A  <  A7,  or 

A  <  (TV  -  3)7. 

But  we  know  that 

A  >  (A  —  2)7  >  (IV  —  3)7 

and  so  UAV3  cannot  take  over  successfully.  We  next  prove  that  in  general  for  k,  2  <  k  < 
N  —  1,  UAVk  cannot  take  over  from  UAVN  without  inducing  a  coverage  gap.  Indeed, 
UAVk  is  able  to  take  over  the  mission  successfully  from  UAVn  if  and  only  if  kT  +  A  < 
NT  or 


A  <  (A  —  k)T,  2  <  k  <  N  —  1. 


But  we  have 


A  >  (TV  -  2)7  >  (JV  -  3)7  >  •••  >  (A  -  k)T, 

therefore,  when  2  <  k  <  N  —  1,  UAVk  cannot  take  over  the  mission  without  incurring  a 
coverage  interruption.  It  remains  to  show  that  UAVi  can  take  over  the  mission  with  no 
coverage  gap.  In  fact  UAVi  is  the  only  one  that  can  do  so.  Indeed  UAVi  is  available  the 
earliest  at  time  7  +  A  and  can  take  over  the  mission  if  and  only  if  7  +  A  <  NT,  or 
A  <  (A  —  1)7.  But,  this  last  inequality  is  given  in  (2.4.3),  and  so  UAVi  inherits  the 
mission  from  UAVn  with  a  successful  handoff.  Let  UAV 1  takes  over  successfully  at  time 
NT  and  loiter  from  NT  to  (A  +  1)7.  At  time  (A  +  1)7  when  UAVi  is  done  with  its 
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tour,  we  show  that  only  UAV2  can  take  over  successfully  the  mission  from  UAVi.  First, 


UAV2  is  available  at  time  27  +  A  and  can  take  over  successfully  if  and  only  if 
2T  +  A  <  (iV  +  1)7,  or  A  <  (jV  —  1)7,  and  thus  UAV2  can  do  it.  Next  we  claim  that 
UAV3  cannot  take  over  successfully  from  UAVi.  Indeed  UAV3  can  take  over  with  no  gap 
if  and  only  if  37  +  A  <  (A/  +  1)7,  or  A  <  (N  —  2)7.  However,  this  last  inequality  does 
not  hold  and  the  claim  for  UAV3  is  true.  It  follows  that  besides  UAV2  none  of  the  other 
UAVs  are  capable  of  taking  over  the  mission  from  UAVi  without  a  coverage  gap.  Now 
when  UAV2  successfully  takes  over  the  mission  a  similar  argument  shows  that  only 
UAV3  can  successfully  succeed  UAV2.  Repeating  the  same  argument  over  several  times 

shows  that  UAV!  4  UAV2  4  UAV3  4  ...  4  UAV.v  and  when  UAV;V  4  UAV, 

another  identical  cycle  starts  all  over  again.  The  proof  of  the  theorem  is  now  complete. 


2. 4. 2  Monotonicity  Properties 

The  next  results  show  the  number  of  UAVs  needed  to  ensure  continuous  coverage 
depends  monotonically  on  the  UAV  roundtrip  and  the  loitering  times. 

Corollary  2.4.2  With  the  loitering  time  T  held  constant,  the  number  of  UAVs  needed  for 
continuous  coverage  is  an  increasing  function  of  the  round  trip  A  =  ^  +  <f2  +  <f3. 

Proof.  We  know  from  an  earlier  result  that  the  optimal  number  of  UAVs  N  satisfies 
( N  —  2)7  <  A  <  {N  —  1)7.  The  first  inequality  is  equivalent  to  N  <  A/7  +  2  while  the 
second  one  is  equivalent  to  A/7  +  1  <  AT  It  follows  by  combining  them  that  A/7  +  1  < 
N  <  A/7  +  2  .  Clearly,  the  result  follows  since  the  function  A  -»  A/7  is  an  increasing 
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function.  In  fact,  it  is  the  ratio  A /T  that  detennines  the  optimal  number  of  UAVs 
ensuring  continuous  coverage. 

Corollary  2.4.3  With  the  roundtrip  time  held  constant,  the  number  of  UA  Vs  needed  for 
continuous  coverage  is  a  decreasing  function  of  the  loitering  time  T. 

Proof.  Similar  to  the  proof  above  since  A/T  +  1  <  N  <  A/T  +  2  and  the  function 
T  ->  A/T  is  decreasing. 


2.5  Conclusion 

In  this  chapter  a  simplified  version  of  the  UAV  continuous  coverage  problem  was  studied 
and  a  fonnula  for  the  optimal  number  of  UAVs  needed  for  continuous  coverage  was 
derived.  The  formula  is  based  on  the  ratio  of  the  roundtrip  time  to  the  loitering  time  of  the 
UAV.  This  suggests  that  the  ratio  T / A  can  be  used  as  a  productivity  metric  of  a  UAV. 
The  higher  T  / A  is  the  better  since  it  means  the  UAV  is  more  productive  by  providing 
more  loitering  time  with  smaller  support. 
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Chapter  3 


III.  THE  MODEL  FOR  A  NON-HOMOGENE  OUS  UAV  FLEET 

3.1  Introduction 

The  previous  chapters  studied  the  UAV  continuous  coverage  problem  with  a 
homogeneous  UAV  fleet  where  all  the  UAVs  had  the  same  attribute  vectors.  This  first 
approach  has  two  advantages.  First  from  a  theoretical  viewpoint  it  allowed  us  to  derive  a 
fonnula  for  the  optimal  cyclic  schedule  by  just  finding  the  minimum  number  of  UAVs 
needed  for  continuous  coverage  since  all  of  them  are  identical.  It  allows  us  to  get  basic 
insights  and  understanding  of  the  problem  that  can  serve  as  a  stepping  stone  for  the  study 
of  more  complex  problems.  Secondly,  from  a  practical  viewpoint  it  may  just  happen,  for 
maintenance  purposes  for  example,  that  all  available  UAVs  are  of  the  same  type  in  which 
case  the  model  applies.  A  logical  way  of  generalizing  the  previous  model  is  to  study  the 
coverage  problem  assuming  a  non-homogenous  UAV  fleet.  This  approach  is  even  more 
realistic  because  different  UAVs  offer  unique  features  that  can  serve  specific  purposes. 
The  USAF  for  example  uses  three  types  of  UAVs;  namely,  the  MQ-1  Predator,  MQ-9 
Reaper,  and  RQ-4  Global  Hawk.  These  three  types  of  UAVs  have  their  unique 
characteristics  and  perfonnance  capabilities.  Though  the  MQ-9  Reaper  is  based  on  the 
MQ-1  Predator,  they  do  not  have  the  same  perfonnance  abilities.  MQ-9  reaper  has  a 
faster  cruise  speed  than  MQ-1  Predator  and  it  has  more  offensive  features  since  it  was 
designed  to  offer  a  striking  capability  by  carrying  up  to  eight  Hellfire  missiles.  Global 
Hawk,  with  RQ-4B  being  its  most  current  version  of  the  vehicle,  is  primarily  designed  for 
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ISR  missions.  It  has  no  striking  capabilities  but  its  high  altitude  and  long  operational 
radius  give  it  a  great  survivability  and  operational  flexibility.  These  UAV  will  be 
described  in  more  details  in  a  chapter  devoted  to  some  numerical  applications.  This 
chapter  studies  the  non-homogeneous  model  first  with  deterministic  and  then  with 
stochastic  UAV  attributes.  Deterministic  linear  programming  and  chance-constrained 
programming  are  used  to  formulate  the  continuous  coverage  problem. 


3.2  Model  with  Non-identical  UAVs 

In  the  basic  model  it  is  shown  that  an  interesting  relationship  exists  between  the  UAV 
attribute  vectors  and  coverage  that  is  the  loitering  and  roundtrip  times  are  key  variables  to 
ensure  the  continuous  coverage.  We  next  proceed  to  establish  similar  results  when  the 
UAVs  are  not  necessarily  identical.  This  model  is  more  complex  and  will  turned  out  to  be 
a  difficult  combinatorial  optimization  problem. 


3.2.1  Feasibility  Condition  with  Non-identical  UAVs 

The  purpose  of  the  next  result  is  to  understand  when  the  simplest  schedule,  namely  a 
schedule  of  size  two,  is  feasible.  The  conditions  that  the  attributes  of  these  two  UAVs 
must  satisfy  will  be  extended  to  larger  schedules.  In  essence,  the  idea  expressed  in  the 
next  result  will  be  used  to  characterize  feasibility  for  more  general  schedules.  We  first 
consider  a  cyclic  schedule  of  size  2.  Let  (A1;  Tx)  and  (A2,  T2)  be  the  attribute  vectors  of 
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these  two  UAVs.  Define  S0  =  0,  Sl  =  Tt,  52  =  71  +  T2,  and  Sk  =  Tt  +  T2  +  — I-  Tk, 
for  k  >  1. 

Proposition  3.2.1  Two  UAVs  with  attribute  vectors  (A  1,T1)  and  (A2,  T2)  form  a 
feasible  schedule  if  and  only  if  Ax  <  T2  and  A2  <  T1.  That  is  (A1;A2)  <  (T2,  Tf) 
where  the  vector  ordering  is  taken  in  the  traditional  sense  of  componentwise  comparison. 

Proof.  Consider  the  chart  of  Figure  1 1  which  shows  a  size  2  schedule. 

UAVi :  | - 1//////////////| - 1 - 1//////////////| - >  time 

So=0  Si  Si+Aj  S2  S3  S3+A1 

UAV2 :  I - 1. - -|//////////////| - 1- - 1 - >time 

So=0  Si  S2  S2+A2  S3  S4 

Figure  1 1 .  Cyclic  Schedule  with  Two  Non-identical  UAVs 

Note  that  the  following  sequence  of  events  take  place.  UAVi  loiters  from  time  0  to  7\ 
and  is  available  the  earliest  at  time  Si  +  A1.  Then  UAV2  loiters  from  time  Si  to  S2  and 
is  available  the  earliest  at  time  S2  +  A2.  Evidently  in  the  first  cycle  each  UAVs  can  take 
over  the  mission  with  no  coverage  interruption  from  the  previous  UAV.  When  UAV2  is 
done  loitering  at  time  S2,  we  check  whether  UAVi  is  available  to  take  over  the  mission 
successfully  from  UAV2.  UAVi  is  operationally  ready  the  earliest  at  time  Sj  +  Aj  and 
can  take  over  the  mission  from  UAV2  without  inducing  a  coverage  gap  if  and  only  if 

Si  +  Ai  <  S2 
or 

Ai  <  T2. 

This  inequality  simply  translates  the  fact  that  after  departing  from  the  target  area  UAV  1 
should  be  able  to  return  to  it  before  UAV2  is  done  with  its  loitering  tour  for  otherwise  a 
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coverage  gap  will  be  generated.  Using  symmetry  we  can  immediately  conclude  that 
UAV2  takes  over  the  mission  at  S2  from  UAVi  with  no  coverage  gap  if  and  only  if 
A2  <  T1.  However,  we  proceed  to  show  that  it  is  indeed  the  case.  At  time  S2,  let  UAVi 
take  over  the  mission  assuming  that  A2  <  T1.  When  UAVi  is  done  loitering  at  time 
S 2  +  Tx  then  UAV2  takes  over  at  time  S2  +  Tx  without  no  coverage  gap  if  and  only  if 
it  is  operationally  ready  and  available  at  S2  +  Tx  ;  which  translates  to 

S2  +  A2  <  S2  + 

where,  once  again  S2  +  A2  is  when  UAV2  is  operationally  ready  and  S2  +  T1  is  when 
UAV 1  is  done  with  its  tour.  It  follows  from  the  previous  inequality  that  UAV2  is  available 
to  take  over  without  coverage  interruption  if  and  only  if  A2  <  Tx .  T 0  summarize  we  have 
the  following  :  When  UAV2  is  done,  UAVi  can  take  over  with  no  coverage  gap  if  and 
only  if 

Ai  <  T2, 

and  when  UAV  1  is  done,  UAV2  can  take  over  with  no  gap  if  and  only  if 

A2  <  7i- 

Therefore,  the  two  UAVs  are  the  exact  number  of  UAVs  needed  for  continuous  coverage 
if  and  only  if 

Ax  <  T2  and  A2  <  T1 
or  (A1(A2)  <  (T2,  as  claimed. 
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We  next  search  for  a  necessary  and  sufficient  condition  which  ensures  that  a  UAV 
schedule  of  a  higher  size  n  >  2  is  feasible.  The  case  of  a  size  2  schedule  was  examined 
previously  and  we  found  it  to  be  feasible  if  and  only  if 

A-l  <  T2  and  A2  <  T±. 

We  next  consider  2  schedules  of  size  3  and  4  respectively  and  study  their  feasibility.  An 
emerging  pattern  will  help  us  formulate  the  feasibility  conditions  of  a  cyclic  schedule  and 
proceed  to  prove  them  in  a  formal  way. 

Case  1  :  Schedule  with  n  =  3  UAVs. 

The  Gantt  chart  for  a  cyclic  schedule  of  size  3  is  depicted  in  Figure  12. 

UAV  , :  | - 1///////////////////////////////| - 1 - 1 /////////////////-> 

So=0  Si  Si+A]  S3  S4 

UAV  2:  | - 1— - 1///////////////////////////////| - 1- - -> 

So=0  Si  S2  S2+A2  S4 

UAV  3:  | - 1 - 1 - 1////////////////////////////| - > 

So=0  Si  S2  S3  S3+A3 

Figure  12.  Feasible  Schedule  with  3  UAVs 
From  the  previous  chart  we  have  the  following  sequence  of  events: 

UAVi:  Loiters  in  [S0  ,  S-J,  is  done  at  Sl5  and  is  operationally  ready  the  earliest  at 

+  Ax. 

UAV2:  Loiters  in  [5X  ,  S2],  is  done  at  S2,  and  is  operationally  ready  the  earliest  at 

52  +  A2  • 

UAV3:  Loiters  in  [S2  ,  S3],  is  done  at  S3,  and  is  operationally  ready  the  earliest  at 

53  +  A3 . 
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Starting  from  the  beginning  of  cycle  1  (i.e.,  S3)  we  translate  a  series  of  successful 
handoffs. 

S 

UAV3  -»  UAVi  :  UAVi  is  operationally  ready  the  earliest  at  time  S±  +  A1  and  can  take 

over  the  mission  with  no  gap  if  and  only  if  +  Ax  <  S3  or 

A 1  <  T2  +  T3. 

UAVi  -*  UAV2  :  This  can  happen  if  and  only  if  S2  +  A2  <  S3  +  7\  or  A2  <  Tt  +  T3. 

UAV2  -»  UAV3  :  This  can  happen,  if  and  only  if  S3  +  A3<  S3  +  T1  +  T2  or 

A3<  Tt  +  T2. 


Putting  the  previous  results  together  gives  the  following: 

UAV3  4  UAVi  <=>  A1<T2  +  t3 
UAVi  4  UAV2  <=>  A 2<T1  +  T3 
UAV2  4  UAV3  <=>  A3  <  1\  +  T2 

A  pattern  seems  to  be  emerging  between  the  roundtrip  of  a  UAV  and  the  loitering  times 
of  the  other  UAVs.  To  confirm  that  we  next  investigate  the  feasibility  of  a  schedule  of 
size  4. 

Case  2  :  Schedule  with  n  =  4  UAVs. 
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We  now  consider  a  cyclic  schedule  of  size  4  and  search  for  conditions  that  ensure  its 
feasibility.  Using  the  same  reasoning  as  in  the  previous  case  we  arrive  at  the  following 
statements: 

UAV4  4  UAVi  <=>  S1  +  A1  <  S4 
UAVi  4  uav2  ^  s2+  a2<s4  +  t1 
uav2  4  uav3  <=>  s3  + a3<s4  +  t1  +  t2 

uav3  4  uav4  <=>  s4  +  A4  <  S4  +  Tt  +  t2  +  t3 

These  are  equivalent  to: 

uav4  4  uavi  <=>  a4  <  r4  +  t2  +  t3 
UAVi  4  UAV2  <=>  A 2<T1  +  T3  +  TA 
uav2  4  uav3  <=>  a3  <  t±  +  t2  +  r4 

uav3  4  uav4  <=>  a4  <  t4  +  t2  +  t3 

The  four  perfect  handoffs  of  the  schedule  have  been  translated  into  four  equivalent 
inequalities.  A  careful  look  at  these  inequalities  confirms  the  pattern  that  has  been 
observed  earlier.  Namely,  feasibility  is  based  on  the  principle  that  the  roundtrip  time  of 
each  UAV  must  be  smaller  than  the  aggregated  loitering  times  of  the  other  UAVs  of  the 
schedule. 

Consider  a  feasible  schedule  of  size  n  denoted  by  A  —  ((A1,'T1), ...  ,  (An,  Tn)).  Define 
the  scheduling  cycles  as  follow.  Let  cycle  0  to  be  in  the  interval  [0,Sn],  cycle  1  in 
[Sn,  2Sn]  and  in  general  cycle  k  in  [kSn,  (k  +  l)Sn],  for  k  >  0.  The  principle  that  has 
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been  observed  earlier  by  studying  the  feasibility  of  cyclic  schedules  of  sizes  2,  3,  and  4 
is  now  formally  stated  and  proved. 

Theorem  3.2.2  The  cyclic  schedule  A  =  ((A1,T1),  (A2,T2), ,  (An,Tn))  is  feasible  if 
and  only  if 

n 

A j<  ^  Tl  ,  for  j  =  1,2,  ...,n 

i=l,i*j 

Proof.  The  handoff  times  in  cycle  k  >  1  are  given  by  the  set  {kSn  +  Sj\  j  =  1,2,  ...,n}. 
Also  in  cycle  k,  for  each  1  <  j  <  n,  UAVj  is  operationally  available  and  mission  ready 
at  time  kSn  +  Sj  +  A j.  Now  in  cycle  k,  UAVj.i  is  done  with  its  surveillance  tour  at  time 
kSn  +  Sj-!.  But  UAVj  in  cycle  Ac  —  1  is  operationally  ready  at  time  (/c  —  l)Sn  +  Sj  + 
A j .  Therefore,  UAVj  can  take  over  with  no  coverage  gap  if  and  only  if 

(/c  —  l)Sn  +  Sj  +  A j  <  kSn  +  Sj_i 

or 

Aj  <  Sn  -  Tj 

n 

-  2> 

i=l,i*j 

The  next  result  shows  that  although  a  cyclic  schedule  is  defined  as  an  ordered  sequence 
of  UAVs,  it  turns  out  that  as  far  as  feasibility  is  concerned  the  order  of  the  UAVs  in  a 
cyclic  schedule  does  not  matter.  That  is  mainly  due  to  the  fact  that  feasibility  depends  on 
the  relationship  between  the  roundtrip  time  of  a  UAV  and  the  aggregated  loitering  times 
of  the  remaining  UAVs. 
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Proposition  3.2.3  If  a  cyclic  schedule  A  =  (V1,  V2,  ...,  Vn )  with  Vt  =  (A£,  7)),  i  = 
1,2, ... ,  n  is  feasible,  then  any  permutation  of  this  schedule  is  also  feasible. 

Proof.  Let  (Vi,  V2,  ....  Vn)  =  ((Aj,^),  (A2,T2), ...,  (An,Tn))  be  feasible;  then 

n 

A;-  +  Tj  <  ^  7)  =  Sn,  for ;  =  1,2, ... ,  n. 

t=i 

Now  consider  a  cyclic  schedule  (V^,  Vj2,  ...,  V£  )  where  (ilt  i2, in,)  is  a  permutation 
of  (1,2,  ...,n).  Then 


Therefore, 


Aj  +  T[.  =  Afc  +  Tk,  for  some  k  =  ij. 


A£;.  +  Ttj  <  Sn,  for ;  =  1,2, ... ,  n  ; 
and  thus  (V£  ,  Vi2,  V£  )  is  feasible. 

Proposition  3.2.3  can  be  very  helpful  when  solving  very  large  scale  UAV  coverage 
problems.  More  specifically,  as  will  shown  later,  the  UAV  continuous  coverage  problem 
is  a  combinatorial  optimization  problem  which  is  fonnulated  as  a  zero-one  integer 
program  (25:  Sec  1.2  ;  26)  and  is  known  to  be  computationally  NP  hard  (4:13,  34). 
Therefore  to  find  good  solutions  for  large  problems  one  needs  to  resort  to  heuristics.  The 
previous  proposition  can  help  in  reducing  the  number  of  size  k  schedules  to  process 
during  a  heuristic  search  by  a  factor  of  k\  because  all  the  permutations  of  a  schedule 
correspond  in  fact  to  one  schedule. 
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3.2.2  Characterization  of  Minimality 


A  feasible  cyclic  schedule  is  graphically  represented  as  a  circuit  where  each  node  stands 
for  a  UAV  and  each  arc  for  the  mission  handoff  from  a  UAV  to  the  immediate  next 
successor.  An  arc  here  also  means  the  handoff  is  successful  because  it  does  not  incur  a 
coverage  gap.  If  a  UAV  can  hand  over  the  mission  successfully  to  a  UAV  which  is  not  an 
immediate  successor  then  a  feasible  cyclic  schedule  of  smaller  size  can  be  found  and  the 
original  schedule  cannot  be  optimal.  This  motivates  us  to  introduce  the  “minimality” 
concept  of  a  schedule. 

Definition  3.2.4  A  feasible  cyclic  schedule  S  is  minimal  if  no  proper  sub-schedule  of 
S  is  feasible. 


Figure  13.  A  Feasible  but  Not  Minimal  Schedule  with  6  UAVs 

Therefore  a  feasible  schedule  is  minimal  if  it  does  not  contain  a  proper  circuit.  Figure  13 
shows  a  feasible  cyclic  schedule  (UAVi,  UAV2,  UAV3,  UAV4,  UAV5,  UAVe)  which  is 
not  minimal  because  it  contains  the  feasible  cyclic  schedule  (UAVi,  UAV2,  UAV3, 
UAVe).  Note  also  that  a  minimal  cyclic  schedule  is  not  the  same  as  a  minimum  cyclic 


38 


schedule  because  as  minimum  schedule  is  necessarily  minimal  but  not  the  other  way 
around. 

For  the  purpose  of  deriving  the  minimality  conditions  of  an  arbitrary  feasible  cycle  we 
first  investigate  those  conditions  for  a  small  schedule  of  size  6  of  the  form  S  = 
(Vlt  V2, ...  14)  where  =  (AL,  Tt) ,  i  =  1,2,  The  conditions  obtained  for  this 

schedule  will  be  generalized  to  any  feasible  cyclic  schedule. 


Figure  14.  A  Minimal  Feasible  Cyclic  Schedule 

In  Figure  14,  the  feasibility  of  S  is  represented  by  the  solid  handoff  arcs  and  the 
minimality  of  S  is  represented  by  the  fact  that  the  dotted  handoff  arcs  should  not  take 
place.  In  the  cyclic  schedule  S  =  (Vll  V2, ...  ,  F6)  the  UAVs  need  to  loiter  and  relay  each 
other  in  an  orderly  fashion  as  dictated  by  the  cyclic  schedule  for  them  to  ensure 
continuous  coverage.  We  proceed  to  translate  the  handoff  arcs  in  Figure  14  for  each  UAV. 
Each  UAV  gives  rise  to  a  set  of  inequalities.  First,  consider  the  handoff  arcs  which  stem 
from  UAVi. 

From  the  feasibility  criterion  seen  earlier  in  order  for  UAV2  to  have  the  capability  to  take 
over  the  mission  successfully  from  UAVi  its  roundtrip  A2  must  satisfy  : 
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UAVi  ->  UAV2  <=*  A2  <  Tx  +  T3+  7’4  +  Ts  +  T6. 


To  ensure  minimality  UAVi  should  not  have  the  capability  to  bypass  UAV2  and  hand 
over  the  mission  to  UAV3  successfully.  To  clarify  that  consider  the  following  chart. 


UAVi- 

UAV2 

UAV3- 

UAV4- 

UAV5 

UAV6 


Ti 


Ti 


T2 


T2 


<4 - A _ _ ^ 

T3  ..  T4+T5+T6+T1 

1 

1 

T3 

- If  '  '  "a,"  “T" 

>r : 

1 

I  T4 

T4  ,  | 

4-  - 

1 

1  T5  1 

1  T5 

1  X6  1 

1 

1  Ta  ' 

Figure  15.  Minimality  Condition  for  UAV3  Roundtrip  Time 

When  UAVi  finishes  its  loitering  time  it  is  required  that  UAV3  should  not  be  able  to  take 
over  the  mission  form  UAVi.  In  other  words  A3  <T4  +  T5  +  T6  +  T1  should  not  hold 
and  so  the  following  inequality  is  needed  for  the  minimality  of  the  schedule. 

UAVi  4  UAV3  <=>  T4  +  T5+ T6  +  T4  <  A3. 

The  other  minimality  conditions  which  are  based  on  the  principle  that  a  UAV  should  not 
be  able  to  handover  the  mission  to  any  other  UAV  but  its  immediate  successor  in  the 
cyclic  schedule  are  derived  in  a  similar  fashion.  They  are  : 


UAVi 

¥ 

uav4 

T’s+T’e  +  Ti  <  A4 

UAV! 

UAVs 

7^6  T  T4  <  A5, 

UAVi 

uav6 

<=4> 

7i  <  A6. 

Using  the  same  principle  as  before  each  of  the  remaining  UAVs  will  generate  a  group  of 

feasibility  and  minimality  conditions  as  follows. 
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UA  V 2 

uav2 

s 

— > 

uav3 

<=> 

A 3  <  Ti  +  T2+  T4  +  T5  +  T6 

uav2 

/ 
— > 

uav4 

T5  +  76  +  Tt  +  T2  <  A4 

uav2 

4 
— > 

uav5 

t6+  t±  +  T2  <  a5 

uav2 

uav6 

<=> 

t±  +  t2<  a6 

uav2 

4 

-¥ 

UAV! 

<=> 

T2  <  A1 

UAV3 

uav3 

s 

—> 

uav4 

<=> 

A4  <  T±  +  T2+  T3  +  T5  +  T6 

uav3 

t 

uav5 

<=> 

T6  +  Tt+  T2  +  T3<  A5 

uav3 

t 
— > 

uav6 

<=> 

t1  +  t2  +  t3<  a6 

uav3 

4 
— > 

UAVi 

<=> 

T2  +  T3  <  A, 

uav3 

4 
— > 

uav2 

<=> 

T3  <  A  2 

UA  V  4 

uav4 

4uav5 

<=> 

a5  <  t4  +  72+  r3  +  t4  +  t6 

uav4 

— > 

uav6 

<=> 

Ti  +  ^2+  T3  +  74  <  A6 

uav4 

— > 

UAVi 

<=> 

t2+t3  +  t4<a1 

uav4 

— > 

UAV, 

<=> 

T3  +  t4  <  a2 

uav4 

X 
— > 

uav3 

4=> 

t4  <  a3 

UAV  5 

uav5 

s 

uav6 

<=> 

a5  <  t4  +  r2+  r3  +  r4  +  r5 

uav5 

X 

UAVi 

<=> 

r2  +  73+  74  +  r5  <  a4 

uav5 

X 

uav2 

<=> 

73  +  74+75  <  a2 

uav5 

X 
— > 

uav3 

<=> 

74  +  75  <  A3 

uav5 

X 

uav4 

<=> 

75  <  A4 

UAV  6 

uav6 

s 

— > 

UAVi 

<=> 

A4  <  72  +  73+  74  +  75  +  76 
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uav6  4  uav2  <=>  t3  +  t4+  t5  +  t6<  a2 

uav6  4  uav3  <=>  t4  +  t5+t6  <a3 

uav6  4  uav4  <=>  t5  +  t6<  a4 

uav6  4  uav5  <=>  t6<  a5 

From  the  above  inequalities,  the  feasibility  part  gives: 

6 

A;-  <  ^  Tt  for;  =  1,2,  ...,6 

which  is  as  given  in  Theorem  3.2.2  when  n  —  6.  Next,  we  collect  those  inequalities 
involving  the  roundtrip  durations  to  establish  the  conditions  that  ensure  minimality  of  this 
schedule. 


Inequality  for  At 

:T2  +  T3  +  T4  +  T5<  Alt 

Inequality  for  A2 

:  T3  +  T4  +  T5  +  T6<  A2, 

Inequality  for  A3 

:  T1  +  T4  +  T5  +  T6  <  A3, 

Inequality  for  A4 

:  T1  +  T2  +  T3  +  Tb<  A4, 

Inequality  for  A5 

:  T1  +  T2  +  T3  +  T6  <  As, 

Inequality  for  A6 

:  Ti  +  r2  +  t3  +  r4  <  a6. 

It  follows  that  the  round  trip  times  need  to  satisfy  the  following  inequalities  for  the  cyclic 
schedule  to  be  feasible  and  minimal. 


T2  +  T3  +  t4  +  t5  <  a,  <  r2  +  t3  +  t4  +  t5  +  t6 
t3  +  t4  +  t5  +  t6<a2<t1  +  t3  +  t4  +  ts  +  t6 
t1  +  t4  +  t5  +  t6<a3<t1  +  t2  +  t4  +  t5  +  t6 
t1  +  t2  +  t5  +  t6<a4<t1  +  t2  +  t3  +  t5  +  t6 
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7\  +  t2  +  T3  +  Tb  <  A5  <  7\  +  t2  +  t3  +  r4  +  t6 
t1  +  t2  +  t3  +  t4<  a6<tx  +  t2  +  t3  +  t4  +  t5 

It  follows  that,  in  general,  in  order  to  obtain  the  feasibility  and  minimality  conditions  of 
the  cyclic  schedule  S  =  ((A1;  Tf),  (A2,T2), ...,  (An,  Tn))  we  must  have  for  each 
i  =  2, 

T\  d - f  Tj_ 2  +  Ti+1  H - h  Tn  <  A(  <  Tt  H - 1-  T t_t  +  Ti+1  H - 1-  Tn 

and  for  i  =  1, 

r2  +  r3  +  -  +  Tn-1  <  A1<T2  +  T3-\ - 1-  Tn. 

This  result  is  stated  next  and  proved  formally. 

Theorem  3.2.5  Let  A  —  (Kl5  V2,  ...,  l^)  be  a  cyclic  schedule  where  Vj  =  (A £,  7^)  ybr 
i  =  1,2,  Define  by  T0  —  Tn  and  Sk  —  Tt  +  T2  +  — I-  Tk,  1  <  k  <  n.  Then,  A  is 
feasible  and  minimal  if  and  only  if 

sn  ~  Tj- 1  <  f  +  A j  <  Sn,  j  =  1,2,  ...,n  (3.2.1) 

Before  proving  this  result  note  that  (3.2.1)  is  equivalent  to  the  following  two  groups  of 
inequalities: 

n 

Tj  +  Aj  <  '^Ti  for;  =  1,2,  ...,n,  (3.2.2) 

i= 1 

and 

n 

Yjt-Tj-!  <  TJ+AJ  for;  =  1,2,  ...,n.  (3.2.3) 

t= i 

It  is  easy  to  see  that  (3.2.2)  is  equivalent  to 
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IL 

4/  — 

i= l 

n 

=  ^  7i  ,j  =  l,2,...,n. 


i=l,i*  j 

But  these  are  just  the  feasibility  inequalities  that  have  been  proved  earlier.  Note  that 
inequalities  (3.2.3)  are  equivalent  to  : 


n 

^  Tt  -  Tj_x  <  Tj  +  A j  ,j  =  1,2, ... ,  n 

t=i 


or 


n 

^  Tt  -  Tj_1  <  A j  ,j  =  1,2, 

As  separate  the  cases  j  =  1  and  7  >  2,  they  can  be  written  as: 


n 

^  Tt<  Aj  ,  j  —  2,3,  ...,n 


and 


n- 1 

2><A i  ■J  =  1- 

i= 2 

Therefore,  for  minimality  we  need  to  show  the  following  inequalities  : 


n 

^  Tj  <  Aj  ,j  =  2,3,  ...,n  (3.2.4) 


and 
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(3.2.5) 


71-1 

'ZT‘<&i  J=1- 

i= 2 

Proof  of  Theorem  3.2.6.  The  feasibility  was  proved  earlier.  We  focus  on  the 
minimality.  Let  us  draw  a  picture  which  in  fact  is  an  extract  from  the  Gantt  chart  of  the 
UAV  cyclic  schedule  of  size  n  because  it  focuses  on  cycles  k  and  k  +  1  of  the 
schedule. 


Cycle  k+1 


Cycle  k 


UAVj-2 


UAVj-i 


UAVj 


Tj-2  j  i_ Tj£ 


Tj-i 

Tj-i  ;  : 

;  i 

i  : 

j  Case  A  1 

T  < - * 

Tj 

;  1  J  1 

|  |  Case  B 

>  i 

j  !  kSn+Sj+Aj 

kSn+Sj+Aj 

kSn+Sj-2  kSn+Sj-1  kSn+Sj  (k+l)Sn+Sj-2  (k+l)Sn+Sj-l  (k+l)Sn+Sj 


Figure  16.  Cycle  k  and  k+1  of  The  Schedule  of  Size  n 


This  picture  shows  that  UAVj.i  is  done  loitering  at  time  (k  +  l)Sn  +  Sj_t  and  UAVj.i  is 
ready  to  pass  on  the  mission  to  the  next  UAVj  at  that  time.  UAVj  can  make  it  to  the  target 
area  to  take  over  the  mission  from  UAVj.i  because  the  schedule  is  feasible.  The  earliest 
time  that  UAVj  is  available  to  take  over  loitering  is  at  time  kSn  +  Sj  +  Aj  .  We  know 
from  feasibility  that 

kSn  +  Sj  +  A j<  (k  +  l)Sn  +  Sj_±. 

In  order  to  ensure  minimality  we  should  make  sure  that  UAVj  does  not  have  the 
capability  to  be  available  and  mission  ready  before  UAVj.i  does,  for  otherwise  there  is  no 
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need  to  have  UAVj.i  in  the  schedule.  In  Figure  16,  we  represented  the  time  kSn  +  Sj  + 
A j  for  two  possible  cases  denoted  by  (A)  and  (B).  The  time  kSn  +  Sj  +  A j  is  always  less 
than  or  equal  to  ( k  +  l)5n  +  Sj_1  because  of  feasibility.  Both  cases  (A)  and  (B)  satisfy 
that  ;  to  ensure  minimality  we  basically  avoid  the  occurance  of  the  situation  depicted  in 
case  (B).  Namely,  UAVj  should  not  be  available  before  time  ( k  +  l)Sn  +  Sj_±  for 
otherwise  UAVj.i  would  not  be  needed.  Thus,  we  must  have  : 

(/c  +  l)Sn  +  Sj_ 2  <  kSn  +  Sj  +  A j, 

$n  ~  (Sj  ~  Sj- 2)  <  ^j> 
sn  -  ( Tj  -  Tj_1)  <  A j  ,j  =  1,2, ... ,  n, 
or 

n 

Z  Ti<A>  ■>=1’2 . n- 

i=l,i*j,i*j-l 

Indeed,  if  the  above  inequality  holds  in  the  opposite  direction,  that  is  if 

kSn  +  Sj  +  A j  <  (k  +  1)5jx  T  Sj— 2, 

then,  in  cycle  (fc  +  1),  UAVj.i  can  be  skipped  by  “switching”  from  UAVj.2  to  UAVj  and 
then  the  schedule  will  not  be  minimal.  For  the  case  j  —  1,  since  UAVi  follows  UAVn  (i.e. 
UAVn  preceeds  UAVi)  in  the  schedule  we  must  have 

$n  ~  (Tn  —  ^l)  <  ^1 

or 
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The  proof  is  now  complete. 


n- 1 


I 


Tt  <  A,. 


3.2.3  Handling  Small  Coverage  Gaps 

So  far  the  model  we  considered  assumed  that  handoffs  between  UAVs  are  perfect  in  the 
sense  that  no  coverage  interruption  takes  place.  In  practice,  however,  it  may  be  the  case 
that  a  relatively  small  coverage  gap  may  be  acceptable  because  it  is  deemed  not  to  affect 
the  mission  objective  and  requirements.  This  leads  to  us  to  introduce  an  extension  of  the 
previous  model  that  takes  into  account  the  fact  an  ISR  mission  can  tolerate  a  small 
coverage  gap  in  a  typical  UAV  handoff.  The  following  charts  shows  a  handoff  between 
two  UAVs  with  a  coverage  gap  of  length  e. 


UAVi 


UAVj - 


Ai  Ai 

Ti  IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIL  Ti  llllllllllllllllllllllllllllllllll 


r? 

/ 

A)  ! 

Tj 

yllllllllllllllllllllllllllllllllllll  ; 

Tj 

gap7 


£  I 

Figure  17.  Coverage  Gap  of  Length  8 


Consider  a  typical  perfect  handoff  from  UAV;  to  UAVj  in  a  cyclic  schedule.  The  handoff 

from  UAV;  to  UAVj  is  perfect  because  A/  —  <  0.  Next  consider  the  situation  where 

the  mission  can  tolerate  a  small  coverage  gap  of  some  length  e  >  0.  This  means  that  we 

now  consider  a  handoff  to  be  successful  if  A,—  7j  <  s.  Note  that  A <  s  is  the 

sense  as  A;<  +  e  and  therefore  by  defining  T[  =  Tt  +  £  for  all  i  we  can  switch 
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from  UAVi  to  UAVj  with  a  gap  of  maximum  length  £  if  and  only  if  A;<  T[.  From  this 
observation,  the  original  cyclic  schedule  S  =  ((A-l,!)),  (A2,T2), ...,  (An,  Tn))  can  be 
transformed  into  a  new  cyclic  schedule  S'  —  ((A1(  7)/),  (A2,'T2,)<  ■■■<  (An,  7)/))  which 
considers  any  positive  gap  in  a  handoff  as  a  successful  handoff  and  therefore  we  back  to 
the  early  setting.  Basically,  the  earlier  definition  of  a  perfect  handoff  is  equivalent  to  a 
handoff  with  a  coverage  gap  of  length  8  =  0  (i.e.,  null  coverage  gap).  In  fact,  when  a 
schedule  can  tolerate  a  coverage  gap  of  a  most  e  it  is  same  as  adding  a  loitering 
capability  of  £  time  units  to  the  UAVs.  It  follows  that  set  of  all  cyclic  schedules  for 
which  a  coverage  gap  of  at  most  £  is  admissible  is  much  larger  than  the  set  of  all 
schedules  with  perfect  handoffs.  Therefore  an  optimal  cyclic  schedule  which  tolerates  a 
positive  gap  will  have  a  smaller  number  of  UAVs  than  an  optimal  schedule  with  perfect 
handoffs.  This  can  be  easily  seen  in  the  particular  case  of  a  homogeneous  fleet  by 
invoking  the  main  theorem  of  the  basic  model.  Since  the  optimal  number  of  UAVs  is 
basically  determined  by  the  ratio  A  /T,  it  follows  that  A/(T+£)<A/T  implies  that 
an  optimal  cyclic  schedule  will  need  a  smaller  number  of  UAVs  when  a  coverage  gap  of 
maximum  length  £  is  acceptable.  It  follows  from  Theorem  3.4.3  that  the  new  cyclic 
schedule  S'  =  ((A1;  7)'),  (A2,  T2)  ...,(An,  T£))  is  feasible  if  and  only  if 

n 

T-  +  A j  <  ^  T ■  for ;  =  1,2, ... ,  n 

i= 1 

or 

n 

A j  <  (n  —  1)£  +  ^  Tt  for  j  =  1,2, ...  ,n 

i=l,i*j 
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This  shows  that  for  the  new  cyclic  schedule  to  be  feasible  each  UAVj  can  be  away  from 
the  target  area  for  an  additional  period  not  exceeding  (n  —  l)e.. 


3.3  Linear  Programming  Formulation 

In  this  section  we  use  linear  programming  to  find  an  optimal  cyclic  schedule  that  ensures 
continuous  coverage  of  the  target  area.  To  formulate  the  UAV  scheduling  problem  as  a 
linear  program  we  need  to  define  the  decision  variables,  objective  function,  and 
constraints  (26). 

Recall  that  the  fleet  F  is  written  as  F  =  {(At,  7j),  (A2,T2), (AK,  TV)} .  First,  we 
define  the  binary  decision  variables  X;  according  to  whether  UAV,  is  included  in  the 
cyclic  schedule  or  not. 

{1  if  UAVj  is  included  in  the  schedule 

0  if  UAVj  is  not  included  in  the  schedule 

Since  the  purpose  is  to  find  the  minimum  number  of  UAVs  that  provides  continuous 
coverage  the  objective  function  of  the  linear  program  is  simply  the  sum  of  the  decision 
variables.  Thus  the  objective  function  is  : 

min  z  =  x1  +  x2  +  — I-  xK. 

The  feasible  region  of  the  continuous  coverage  linear  program  corresponds  to  the  set  of 
all  feasible  cyclic  schedules.  But  the  latter  set  is  characterized  by  Theorem  3.2.2  the 
results  of  which  translate  exactly  into  the  constraints  of  the  linear  program  sought  after. 
For  convenience,  let 
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at  =  Ti  and  bt  =  A;  ,  i  =  1,2, ... ,  K. 


Then  using  Theorem  3.2.2  the  feasibility  conditions  of  a  UAV  cyclic  schedule  are: 


N 


^  a.jXj  >  bt  ,  i  =  1,2,  ...,K. 


i=l,j*i 

Therefore,  the  optimal  cyclic  schedule  is  a  solution  to  the  following  binary  integer 
programming  problem: 


K 


min  z 


=Tx‘ 

i= 1 

subject  to 

N 

^  a.jXj  >  bi  ,  i  =  1,2, ... , 


K 


j= i 
j*i 


Xi  =  {0, 1}K  , all  i  e  {1,2,  ...,K} 

Define  the  KxK  square  matrix  A  —  [a^]  as  follows.  For  each  i  —  1,2 and 
j  =  1,2,  let 


aij  = 


ra.j  ,for  j  —  1,2,  ...,K,j  =£  i 
0  ,  for  y  =  i 


Next  define 


x  =  (x1; x2, ... , Xk)7’,  h  =  (/?!,  fe2,  - ,  bK)T,  and  e  =  (1, 1, ... ,  1), 
where  the  last  row  vector  e  has  K  components. 

Then  the  binary  integer  linear  programming  can  be  rewritten  as: 
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mm  z  =  ex 


subject  to 

Ax  >  b 
x  G  {0, 1}K 


Although  we  do  not  exploit  the  special  structure  of  the  matrix  A  it  is  worth  mentioning 


■o 

a2 

o3 

aK- 1 

aK~ 

a 

0 

a3 

••  oK_  i 

aK 

A  = 

0-2 

0 

aK- 1 

oK 

0-2 

o3 

0 

oK 

a i 

a2 

o3 

aK- 1 

0  . 

is  a  non-negative  matrix.  All  entries  of  a  column  are  the  same  except  for  the  entry  on  the 
main  diagonal  which  is  null.  Its  determinant  is 

K 

det(.4)  =  (—1)K~1(K  -  1)  j- [  ak. 

i= 1 

Than  can  be  seen  as  follows.  First  by  using  row  permutations  we  can  move  the  last  row  to 
the  top  to  have 


detC4)  =  (— 1)^  1det 


a2 

a3 

aK- 1 

0  - 

0 

o2 

o3 

"  oK_  i 

aK 

a i 

0 

a3 

aK- 1 

oK 

a 

o2 

o3 

aK- 1 

oK 

a ^ 

a2 

a3 

0 

oK- 

Then  using  Gauss  elimination  we  get 
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det(A)  =  (— 1)K  xdet 


Cl ^ 

0-2 

a3 

...  Ok_2 

aK- 1 

0 

0 

o2 

a3 

...  aK_  2 

aK- 1 

aK 

0 

0 

a3 

...  Ok_2 

aK- 1 

2  CL 

0 

0 

0 

Or- 2 

aK- 1 

(K  —  3)  a  ft 

0 

0 

0 

0 

aK- 1 

(K  -  2)  a  ft 

_0 

0 

0 

0 

0 

(K  -  l)aK\ 

and  the  result  follows.  Since  all  of  the  loitering  times  ak,  1  <  k  <  K  are  positive 
numbers  it  follows  that  the  determinant  is  not  null  and  A  is  invertible. 

In  this  section  the  UAV  continuous  coverage  problem  is  fonnulated  as  a  binary  integer 
linear  program  model  with  a  minimizing  objective  function.  It  follows  that  for  a  large 
UAV  fleet  this  model  is  a  computationally  NP  hard  problem  because  the  zero-one  integer 
linear  programming  problem  is  known  to  be  NP  hard  (25:  Sec  1.1).  Clearly,  with  a  UAV 
fleet  of  a  small  size  this  model  can  be  solved  within  a  reasonable  time  by  traditional 
techniques  such  as  the  branch  and  bound  method,  but  as  the  UAV  fleet  size  increases  this 
branch  and  bound  technique  is  not  efficient  enough  to  find  an  optimal  solution  because  it 
might  take  a  relatively  long  running  time  and  may  even  fail  to  find  an  optimal  solution. 
Thus,  a  heuristic  algorithmic  approach  (e.g.,  Tabu  search)  may  be  needed  to  solve  the 
model. 


3.4  Stochastic  Model 

We  now  extend  the  UAV  detenninistic  model  to  a  stochastic  model  with  non-identical 
UAVs.  We  assume  that  we  have  a  non-homo geneous  UAV  fleet.  In  practice,  loitering 
and  roundtrip  times  are  random  because  of  weather  conditions,  enemy  hostility,  payload 
weight,  etc.,  and  imperfect  handoffs  may  occur  with  a  positive  probability.  As  a  result, 
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we  assume  that  A  and  T  are  non-negative  random  variables.  Coverage  now  becomes 
probabilistic  and  the  constraints  of  the  binary  integer  program  derived  earlier  should 
reflect  that  by  putting  them  in  the  form: 

P(Continuous  Coverage)  >  threshold  probability. 

For  example  we  may  be  interested  in  finding  the  best  UAV  cycle  schedule  that  provides 
continuous  coverage  90%  of  the  time  by  having  a  constraint  of  the  form 

P(Continuous  Coverage)  >  90%. 

This  leads  in  a  natural  way  to  fonnulate  the  stochastic  version  of  the  UAV  continuous 
coverage  problem  as  a  chance-constrained  programming  problem  (27:  23-27).  This  may 
be  regarded  as  a  “risk  sensitive”  fonnulation  of  the  coverage  constraints.  For  comparison 
purposes  we  may  also  fonnulate  the  coverage  constraints  using  a  “risk-neutral”  approach 
by  taking  the  expected  value  of  the  coverage  constraints. 


3. 4. 1  Risk  Neutral  Model 

The  constraints  of  the  detenninistic  linear  programming  fonnulation  for  the  UAV 
continuous  coverage  problem  are 

K 

^  a.jXj  >  bi,  i  =  1,2, 

7  =  1 
j*i 

The  risk  neutral  approach  consists  in  taking  for  each  i  E  {1,  2, ... ,  K]  the  expected  value 
on  both  sides  of  the  above  constraints.  This  means  that  on  the  average,  the  roundtrip  of 
UAV;  is  smaller  than  the  aggregated  random  loitering  times  of  the  other  UAVs  in  the 
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cyclic  schedule.  The  decision  variables  are  always  deterministic  since  they  translate 
whether  or  not  a  UAV  is  included  in  the  schedule.  Taking  the  expected  values  on  both 
sides  of  the  previous  constraints  yields  : 


K 

^  E[aj]xj  >  E[bi\,  i  =  1,2, ... ,  K 

7  =  1 
j*i 


or 


K 

y  ffjqyjxy  >  y-i,  i  =  1,2 ,...,K 

7  =  1 

)*i 


where  ^  —  E[bi\. 


The  risk  neutral  approach  to  the  stochastic  coverage  problem  is  based  on  the  idea  of 
replacing  each  random  variable  by  its  mean.  Therefore,  when  the  distribution  functions  of 
the  roundtrip  and  loitering  times  are  known,  the  means  are  also  known,  and  a 
deterministic  model  is  easily  obtained.  The  linear  programming  model  that  results 
through  this  process  is  : 

K 

min  z  =  ^  Xi 
i= l 

subject  to 

K 

^E[aj]xj  >  nu  i  E  {1,2, ... , K] 

7  =  1 
j*i 

Xi  =  { 0,1}K,  alii  e  {1,2,..., K) 
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The  previous  approach  was  based  on  the  risk  neutrality  (indifference)  of  the  decision 
maker  by  using  the  expected  value  metric.  The  mean  value  of  a  random  variable  is  just  a 
measure  of  location  and  does  not  say  much  about  the  spread  of  the  values  of  the  random 
variable  around  the  mean  and  this  can  be  unacceptable  to  the  decision  maker  unless  he  is 
insensitive  to  risk.  However,  if  the  decision  maker  cares  about  risk  he  may  choose  an 
appropriate  metric  to  control  it.  The  next  section  introduces  one  approach  to  controlling 
the  risk  by  imposing  a  lower  bound  on  the  continuous  coverage  probability. 


3. 4.2  Risk  Sensitive  Model 


Another  approach  to  handle  the  stochastic  coverage  problem  is  through  chance- 
constrained  programming  and  the  model  obtained  is  this  fashion  is  referred  to  the  as  the 
risk  sensitive  model.  Now  the  parameters  CLj  and  bj ,  1  <  j  <  K  are  non-negative 
random  variables  and  each  coverage  constraint  takes  the  general  form  of 

P(Continuous  Coverage)  >  threshold  probability. 


More  specifically,  by  using  a  threshold  probability  cq,  0  <  cq  <  1  we  can  express  each 
coverage  constraint  as 


K 


^  ajXj  >  bi\  >  at  ,i  =  1,2, ..., 

\j=Xj*i  J 

xt  =  {0,1}*  , all  i  E  {1,2, 


K 


where  ai  denotes  a  lower  bound  to  the  probability  of  satisfying  the  ith  constraint.  A 
special  case  worth  mentioning  is  when  the  threshold  probabilities  a,  are  all  equal  to 
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some  common  value  a.  Note  that  the  decision  variable  xt  is  still  binary  and  the 
objective  function  is  also  detenninistic.  The  chance  constrained  programming  for  this 
UAV  scheduling  problem  is: 


K 


i= 1 


subject  to 


K 


^  ajXj  >bt  \  >ai 
\j=Xj*i 


Xi  =  {0, 1}K 

0  <  «i  <  1,  alii  e  {1,2,..., K) 


where  the  a.j  and  bj  parameters  are  non-negative  random  variables  as  mentioned  earlier. 
Next,  assume  that  the  probability  distribution  function  of  each  bj  is  nonnal  and  the 
parameters  a,  are  constant.  Based  on  these  assumptions  we  can  convert  this  chance 
constrained  programming  model  into  a  linear  programming  model  by  using  properties  of 
normal  distributions. 


For  each  i  G  {1,2 let  bt  be  normally  distributed  with  mean  and  standard 
deviation  cr^.  Then  we  have 


K 

I 


CLjXj 


>bi)  =  P 


djXj  -  /i, 


bi  ~  /V 


where  (bL  —  \ii) / has  the  standard  nonnal  distribution.  Using  the  CDF  table  of  the 
standard  normal  distribution  we  define  Ka.  to  be  the  constant  that  satisfies: 
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p{z  <  Ka.)  =  at 


where  Z~N  (0,1)  and  aL  is  a  number  between  0  and  1.  Thus 


(3.4.1) 


Because  the  goal  is  to  convert  the  chance-constrained  program  model  into  a  linear 
programming  model  we  write  the  constraints  as  : 

fbi  O-jXj  —  /i;'|  -in  js  f  ^  a  o A 

P\ - < - \  >  0Ci  ,i  =  l,2,...,K.  (3.4.2) 

V  ai  °i  ) 

Note  that  Ka.  should  be  smaller  than  (SyLi ,j±iajxj  —  Mi)/^  10  satisfy  the  (3.4.1)  and 
(3.4.2).  As  a  result,  the  constraints 

K 


^  a.jXj  >  bij>  at,  i  —  1,2,  ...,K 


Kj=l,j*i 


are  equivalent  to 


j=i,j^i  CljXj  fii 


>Kai  ,  i  =  1,2,  ...,K 


or 


I 


ajXj  >  ^  +  Ka.Oi  ,  i 


1,2 . K. 


Thus,  the  probability  constraints  are  converted  to  linear  constraints.  Since  the  linear 
constraints  are  equivalent  to  the  probabilistic  constraints  the  previous  chance  constrained 
program  is  reduced  to  the  following  equivalent  linear  program: 
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K 


i= 1 


subject  to 


K 

^  CLjXj  >  Hi  +  Ka.Oi,  i  E{1,2,...,K] 
j=l,j*i 


*i  =  { 0,1},  bj -Ntiii.Oi) 

0  <  (Xi  <  1,  all  i  G  {1,2, ...  ,K }. 


3.5  Conclusion 

In  this  chapter  we  studied  the  UAV  continuous  coverage  problem  for  a  non-homogeneous 
UAV  fleet.  We  fonnulated  the  UAV  coverage  problem  as  a  zero-one  integer  linear 
program  and  introduced  the  notion  of  a  minimal  UAV  schedule  which  can  be  used  when 
solving  large  scale  UAV  continuous  coverage  models  using  heuristics.  Finally  the 
stochastic  coverage  problem  was  fonnulated  as  a  chance-constrained  problem  that  we 
converted  to  a  zero-one  integer  linear  program.  Numerical  examples  will  provided  in  the 
next  chapter. 
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Chapter  4 


IV  NUMERICAL  APPLICATIONS 


4.1  Introduction 

In  the  previous  chapters  we  established  a  modeling  framework  for  the  UAV  continuous 
coverage  problem  and  derived  some  theoretical  as  well  as  practical  results.  The  ultimate 
goal  of  a  model  is  the  applicability  of  its  insights  and  results  to  practical  problems.  A 
model  is  most  useful  when  it  can  be  applied  to  practical  situations  and  has  the  potential  to 
improve  perfonnance  and  add  value  to  the  current  state  of  affairs.  Because  it  is  the  first 
time  that  such  a  UAV  scheduling  modeling  approach  has  been  attempted  practical 
applications  with  potential  benefits  to  the  war  fighter  may  still  need  to  wait  until  further 
results  are  established.  A  great  deal  of  efforts  were  spent  to  find  the  right  mathematical 
approach  to  the  problem  and  as  a  consequence  valuable  applications  may  need  have  to 
wait  until  more  realistic  extensions  of  the  model  are  added.  Nevertheless  in  this  chapter 
we  attempt  to  provide  some  simple  examples  to  illustrate  the  formulations  of  the  UAV 
continuous  coverage  problem  that  we  have  established 

We  speculate  that  the  USAF  has  a  classified  process  for  scheduling  UAVs  to  conduct  ISR 
missions  and  we  have  no  way  of  relating  the  present  efforts  to  that.  Knowing  how  the 
USAF  does  its  scheduling  for  continuous  coverage  may  lead  to  new  ideas  and  possibly 
new  directions  for  more  operationally  relevant  research. 
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The  next  sections  develop  some  simple  numerical  applications  using  the  USAF  UAVs 
that  are  currently  in  use  in  various  part  of  the  world.  These  include  the  MQ-1  Predator, 
MQ-9  Reaper,  and  RQ-4  Global  Hawk  (17:8,10). 

USAF  describes  the  MQ-1  Predator  UAV  as  a  medium-altitude  and  long-endurance  UAV 
system.  It  can  serve  in  surveillance  and  reconnaissance  roles  and  fire  two  Hellfire 
missiles,  and  the  aircraft,  in  use  since  1995,  has  seen  combat  over  Afghanistan,  Pakistan, 
Bosnia,  Serbia,  Iraq,  and  Yemen  (28,  29). 


Figure  18.  MQ-1  Predator 


Table  1.  MQ-1  Predator  General  Characteristics 


Empty  Weight 

512  kg 

Maximum  Speed 

135  mph 

Loaded  Weight 

1,020  kg 

Cruise  Speed 

81-103  mph 

Max  Takeoff  Weight 

1,020  kg 

Stall  Speed 

62  mph 

Service  Ceiling 

25,000  ft 

Range 

2,000  nm 

Endurance 

24  hrs 
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MQ-9  Reaper  is  developed  for  use  by  the  United  States  Air  Force,  the  United  States 
Navy,  Italian  Air  Force,  and  the  Royal  Air  Force.  The  MQ-9  is  the  first  hunter-killer 
UAV  designed  for  long-endurance,  high-altitude  surveillance  (17:63;  24). 


Table  2.  MQ-9  Reaper  General  Characteristics 


Empty  Weight 

2,223  kg 

Maximum  Speed 

300  mph 

Loaded  Weight 

4,760  kg 

Cruise  Speed 

172-195  mph 

Max  Takeoff  Weight 

4,760  kg 

Endurance 

24  hrs 

Service  Ceiling 

50,000  ft 

Range 

1,655  nm 

Figure  19.  MQ-9  Reaper 


RQ-4  Global  Hawk  is  the  fastest  UAV  flying  today,  it  can  provide  a  broad  overview  and 
systematically  target  surveillance  shortfalls  at  long  range  with  long  loitering  times  over 
target  areas.  Also,  it  can  survey  as  much  as  40,000  square  miles  (100,000  square 
kilometers)  of  terrain  a  day  (24,  25). 
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Table  3.  RQ-4  Global  Hawk  General  Characteristics 


Empty  Weight 

3,851  kg 

Maximum  Speed 

454  mph 

Loaded  Weight 

10,387  kg 

Cruise  Speed 

404  mph 

Max  Takeoff  Weight 

10,387  kg 

Endurance 

42  hrs 

Service  Ceiling 

65,000  ft 

Figure  20.  RQ-4  Global  Hawk 


In  this  chapter,  we  study  UAV  continuous  coverage  models  using  some  UAV  fleets 
which  consist  of  these  three  kinds  of  UAVs.  The  previous  results  are  used  to  find  the 
optimal  UAV  number  for  each  UAV  fleet  and  target  areas.  Deterministic  linear 
programming  is  used  first  and  the  stochastic  model  follows. 


4.2  Deterministic  Modeling  Applications 

The  UAV  fleet  we  consider  in  this  section  consists  of  20  UAVs  -  8  MQ-1  Predator’s,  8 
MQ-9  Reaper’s,  and  4  RQ-4  Global  Hawk’s.  The  target  area  is  1,100  miles  away  from 
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the  operating  base.  Each  UAV  needs  5  hours  for  maintenance  and  refueling  and  their 
cruise  speeds  are  obtained  from  the  average  of  the  cruise  speed  range.  Based  on  these 
assumptions  the  loitering  and  roundtrip  times  can  be  calculated.  The  following  table 
displays  the  results  of  the  calculations. 


Table  4.  Roundtrip  and  Loitering  Times  (hours)  :  d—  1,100  Miles 


UAVs 

ii 

6 

6 

Roundtrip  time 

Loitering  time 

MQ-1  Predator 

12.0 

12.0 

5 

28.9 

0.087 

MQ-9  Reaper 

6.0 

6.0 

5 

17.0 

12.0 

RQ-4  Globa i  Hawk 

2.7 

2.7 

5 

10.4 

36.6 

The  values  of  ^  and  <f2  have  been  calculated  based  on  the  UAV  speed  and  distance 
between  the  operating  base  and  target  area.  Adding  these  two  values  to  the  maintenance 
and  refueling  time  (5  hours)  gives  the  roundtrip  of  the  UAV.  The  UAV  loitering  time  is 
obtained  by  subtracting  the  back  and  forth  trip  durations  from  the  UAV  endurance  time. 


In  this  model  there  are  20  binary  integer  decision  variables.  The  matrix  A  is 


■  0 

0.087 

•••  0.087 

0.087 

0 

•••  0.087 

0.087 

0.087 

•••  0.087 

0.087 

0.087 

•••  0.087 

A  = 

0.087 

0.087 

•••  0.087 

0.087 

0.087 

•••  0.087 

0.087 

0.087 

•••  0.087 

-0.087 

0.087 

•••  0.087 

and  the  vectors  b 

and  x 

are: 

b  =  [28.913, 

••,28.913, 

11.978  • 

•  11.978 

36.554  • 

•  36.554' 

11.978  • 

•  11.978 

36.554  • 

•  36.554 

11.978  • 

•  11.978 

36.554  • 

•  36.554 

11.978  • 

•  11.978 

36.554  • 

•  36.554 

11.978  • 

•  11.978 

36.554  • 

•  36.554 

11.978  • 
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Figure  21.  Deterministic  model :  K  =  20,  d—  1,100  miles 


The  obtained  linear  program  model  can  be  easily  solved  using  Microsoft  Excel  Solver. 
The  optimal  cyclic  schedule  consists  of  2  RQ-4  Global  Hawk’s. 

Next  we  assume  that  there  are  no  RQ-4  Global  Hawk  UAVs  because  they  have  already 
been  assigned  to  another  mission  and  the  resulting  fleet  consists  only  of  16  UAVs  8 
MQ-1  Predator’s  and  8  MQ-9  Reaper’s.  With  the  target  being  1,100  miles  away,  the 
optimal  cyclic  schedule  is  found  to  consist  of  three  MQ-9  Reaper’s.  The  matrix  A  is 
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The  following  figure  obtained  from  MS  Excel  Solver  summarizes  the  results. 
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Figure  22.  Deterministic  model:  K  =  16,  d=  1,100  miles 


4. 3  Stochastic  Modeling  Applications 

This  section  illustrates  an  application  of  the  risk  neutral  and  sensitive  models  to  a 
different  UAV  fleet.  Assume  that  the  operating  base  has  16  available  UAVs  with  14 
MQ-1  Predator’s  and  2  MQ-9  Reaper’s  and  that  the  target  area  is  1,000  miles  away 
from  the  operating  base.  Next,  assume  that  the  MQ-1  roundtrip  time  is  normally 
distributed  with  mean  26.8  hours  and  standard  deviation  2.2  hours,  and  that  the  MQ-9 
roundtrip  time  is  also  normally  distributed  but  with  mean  15.9  hours  and  standard 
deviation  1.9  hours.  The  constant  loitering  times  are  2.3  and  13.1  hours  respectively. 
The  following  table  summarizes  the  data. 


Table  5.  UAV  Data  (hours)  :  d—  1,000  Miles 


Loitering  Time 
(Constant) 

Roundtrip  Time  (Normal  Dist.) 

Average 

Standard  Deviation 

MQ-1  Predator 

2.3 

26.8 

2.2 

MQ-9  Reaper 

13.1 

15.9 

1.9 
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First,  let  us  apply  the  risk  neutral  model  which  closely  resembles  the  deterministic  one. 
The  model,  which  has  16  decision  variables,  is 

16 


£= 1 


subject  to 

16 

^  ajXj  >  yu 

j=%j*i 


i  =  1,2, 


,16 


*£  =  {0,1}. 

The  following  figure,  which  is  a  screen  shot  from  Microsoft  Excel  Solver,  shows  the 
matrix  A  and  the  vectors  b  and  x. 
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Figure  23.  Risk  Neutral  Model :  K  =  16,  d—  1,000  miles 

Using  Microsoft  Excel  Solver  we  find  that  the  optimal  schedule  has  4  UAVs  -  2  MQ-1 
Predator’s  and  2  MQ-9  Reaper’s. 

Next,  we  illustrate  the  risk  sensitive  (chance-constrained)  model  with  a  numerical 
example.  Here,  the  loitering  time  is  a  constant  as  given  in  Table  5  and  the  threshold 
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probability  a  is  set  to  0.95.  It  follows  that  Ka  is  1.645  and  the  linear  program 
obtained  from  the  chance-constrained  program  is 


16 

mmz  =  I> 


1  =  1 


subject  to 


16 


^  CLjXj  >  Mi  +  1-645ct i,  i  =  1,2,  ...,16 


Xi  =  {0, 1), 

where  the  matrix  A  is  the  same  as  in  the  previous  model  because  it  depends  only  on  the 
loitering  but  the  vector  b  has  changed  as  shown  in  the  following  screen  shot  obtained 
from  MS  Excel  Solver. 
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Figure  24.  Risk  Sensitive  Model  :  d—  1,000  miles,  a—  0.95 

In  this  model  the  optimal  solution  consists  of  5  UAVs  -  3  MQ-1  Predator’s  and  2  MQ-9 
Reaper’s.  Moreover,  as  a  increases  the  size  of  the  optimal  schedule  also  increases.  For 
example,  if  a  goes  up  to  0.99  then  the  size  of  the  optimal  schedule  goes  up  to  6 
showing  an  increase  of  one  MQ-1  Predator  from  the  previous  optimal  solution.  The 
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following  chart  shows  how  the  probability  a  affects  the  number  of  UAVs  in  the  optimal 


scheduling  solutions. 


Figure  25.  Optimal  Number  of  UAVs  vs.  Threshold  Coverage  Probability 


This  result  shows  that  as  the  threshold  probability  a  increases  the  optimal  number  of 
UAVs  also  increases.  This  is  expected  because  the  optimal  number  of  UAVs  should  go 
up  as  we  require  a  higher  probability  of  providing  continuous  coverage.  In  other  words, 
as  we  reduce  the  risk  of  violating  the  continuous  coverage  constraints  the  required 
number  of  UAVs  should  go  up.  The  technical  justification  for  that  is  simple  and  follows 
from  the  fact  that  the  feasible  region  defined  by 

K 

^  CLjXj  >  Hi  +  Ka.Oi,  i  e  {1,2, ...  ,K } 

7=1.  i*i 

becomes  smaller  as  at  goes  up. 
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Next  we  show  how  the  minimum  number  of  UAVs  varies  as  a  function  of  the  distance  d. 


Here  for  the  risk  sensitive  model  we  let  the  threshold  probability  be  a  =  0.95. 


Figure  26  shows  the  optimal  schedule  size  for  both  the  risk  sensitive  and  the  risk  neutral 
models  as  a  function  of  the  distance  to  the  target  area.  Observe  that  the  risk  sensitive 
curve  is  on  top  of  the  risk  neutral  curve.  That  can  be  explained  by  the  facts  that 

K 

^  CLjXj  >  Hi  +  Ka.Oi,  i  e  {1,2, 
j=l,j*i 


implies  the  constraint 


I 


CLjXj  ^  jLij; 


i  6(1,2 . K), 
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the  feasible  region  of  the  risk  neutral  model  contains  that  of  the  risk  sensitive  model,  and 
both  have  the  same  minimizing  objective  function. 

Note  that  as  the  distance  to  the  target  area  decreases  the  roundtrip  time  of  a  UAV  also 
decreases  and  this  implies  that  for  both  models  the  number  of  UAVs  in  an  optimal 
schedule  goes  down.  We  know  that  the  smallest  and  best  optimal  schedule  is  of  size  two 
because  continuous  coverage  cannot  be  obtained  with  one  UAV.  As  a  result,  as  the 
roundtrip  time  becomes  smaller  and  smaller  both  models  will  eventually  exhibit  an 
optimal  schedule  of  size  two.  This  explains  why  the  curves  in  Figure  26  coincide  for  a 
while  at  the  2  UAV  level. 


4.4  Conclusion 

The  numerical  examples  discussed  in  this  chapter  are  simple  illustrations  of  the  basic 
mathematical  programming  formulation  of  the  continuous  coverage  problem.  Real 
applications  that  can  benefit  the  warfighter  need  to  wait  until  more  realistic  and  practical 
features  of  the  coverage  problem  are  introduced  and  studied.  The  main  purpose  of  this 
study  was  to  lay  the  ground  for  further  investigations  that  may  lead  to  meaningful 
applications.  We  believe  that  both  the  detenninistic  and  stochastic  versions  have  a  high 
potential  to  lead  to  fruitful  applications.  However,  the  stochastic  version  will  very  likely 
need  an  advanced  background  in  stochastic  programming. 
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Chapter  5 

V  CONCLUSION 


5.1  Introduction 

This  research  provides  an  original  approach  to  the  continuous  coverage  problem  by 
developing  a  new  mathematical  model  to  serve  as  a  baseline  model  for  further  UAV 
scheduling  studies.  As  a  result,  various  extensions  of  the  model  are  possible  but  we  only 
mention  a  couple  of  them. 


5.2  Future  Research  Directions 

As  the  UAV  fleet  size  increases  the  complexity  of  the  problem  increases  and  because  of 
the  special  fonn  of  the  objective  function,  there  are  generally  a  large  number  of  optimal 
cyclic  schedules  of  the  same  size.  Therefore  it  would  worthwhile  to  introduce  a  new 
metric  that  can  differentiate  these  optimal  schedules  obtained  earlier.  One  such  metric  is 
the  slack  time  of  a  UAV  within  a  cyclic  schedule.  Based  on  the  definition  of  a  slack  time 
it  is  desirable  that  a  UAV  has  a  large  slack  time  within  a  schedule  to  give  it  time  to 
remedy  any  contingency  that  may  arise  before  deployment  to  the  target  area.  Therefore  a 
cyclic  schedule  with  large  UAV  slack  times  is  more  efficient.  A  metric  that  could 
measure  the  value  of  a  schedule  is  its  total  UAV  slack  time.  This  metric  can  be  used  to 
fonnulate  a  new  objective  function  for  the  zero-one  integer  program.  Weight  or  priority 
coefficients  may  also  be  introduced  to  refine  the  objective  function. 

Another  possible  extension  is  to  use  an  aerial  tanker  to  refuel  the  UAVs.  The  tanker  will 
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be  closer  to  the  target  area  than  to  the  operating  base  for  this  option  to  make  sense.  The 
UAVs  will  fly  for  a  shorter  time  to  refuel  and  their  productivity  will  increase  by  using  the 
extra  time  gained  to  provide  more  loitering  time.  It  follows  that  a  UAV  will  be 
commuting  between  the  target  area  and  the  tanker  but  once  in  a  while  the  UAV  needs  to 
return  to  the  operating  base  for  maintenance  to  keep  its  performance  up.  In  this  case,  a 
UAV  will  have  2  roundtrip  variables  involving  the  tanker  and  the  operating  base.  In  this 
approach  the  safety  of  the  tanker  becomes  a  major  concern.  The  distance  between  the 
tanker  and  the  target  area  is  critical  and  needs  to  be  evaluated  carefully.  The  tanker  may 
also  be  supporting  several  missions  and  the  location  of  the  tanker  is  another  variable 
needing  careful  analysis.  Taking  into  account  the  risks  and  rewards  the  critical  location  of 
the  tanker  can  be  determined.  The  rewards  being  that  a  smaller  number  of  UAVs  will  be 
needed.  A  risk  analysis  needs  to  be  done. 


5.3  Conclusion 

This  thesis  has  introduced  a  new  class  of  cyclic  scheduling  problems  with  a  prototype 
being  the  UAV  continuous  coverage  problem.  A  mathematical  framework  was  initiated 
to  serve  as  a  stepping  stone  to  further  the  study  of  this  class  of  problems.  Various 
theoretical  as  well  as  practical  results  were  derived  and  used  to  formulate  the  basic 
problem  as  a  mathematical  programming  problem.  The  next  step  is  to  build  on  and 
extend  this  framework  by  adding  more  features  to  handle  more  complex  problems  of  the 
same  kind. 
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Appendix  A.  Blue  Dart 


UA  V  Continuous  Coverage  Pays  Off! 

USA  today,  June  15,  2009  wrote  “Lt.  Gen.  David  Deptula,  Air  Force  Deputy  chief  of  staff 
for  intelligence,  surveillances  and  reconnaissance  missions,  said  intelligence  gathering  is 
key  to  counterinsurgency  operations.  An  example,  he  said  in  an  interview,  was  the 
tracking  and  killing  in  2006  of  Abu  Musab  al-Zarqawi,  the  leader  of  al-Qaeda  in  Iraq.  It 
took  600  hours  of  surveillance  by  a  Predator  drone  to  track  Zarqawi  and  a  matter  of 
minutes  for  an  F-16  to  drop  the  bombs  that  killed  him”.  This  excerpt  stresses  the 
importance  of  UAVs  in  supporting  the  warfighter...  A  redoubtable  enemy  has  been 
eliminated.  How  did  the  UAVs  do  it?  How  did  they  provide  continuous  coverage  of 
the  target?  How  many  UAVs  were  there?  One,  two,  three  ...?  How  do  you  find  the 
right  number?  How  were  they  scheduled? 

The  UAVs  performed  600  hours  of  continuous  coverage  to  eliminate  a  redoubtable 
enemy!  Continuous  coverage  was  the  key  to  the  operation  success!  Recently  we 
developed  a  mathematical  model  to  optimize  the  process  of  choosing  the  best  UAV 
cyclic  schedule  to  provide  continuous  coverage  of  a  target  area. 

The  problem  to  be  solved  can  be  easily  understood.  A  critical  ISR  mission  requiring 

continuous  surveillance  and  coverage  of  a  target  area  is  to  be  accomplished  using  UAVs 

as  the  main  resource.  A  UAV  fleet  is  available  at  the  operating  base  to  support  the 

mission.  The  UAV  being  a  valuable  and  scare  resource  is  to  be  frugally  used 

particularly  when  there  are  other  ISR  missions  around  the  world  requiring  UAVs.  The 

main  questions  to  answer  are  how  to  sequence  the  UAVs  to  conduct  the  mission  to 
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provide  continuous  coverage  of  the  target  area  and  how  many  UAVs  are  required 
knowing  that  one  should  not  use  more  UAVs  than  needed.  Continuous  coverage  is  a  key 
requirement.  Ideally,  if  possible,  there  should  not  be  coverage  gaps  at  all  since  that  may 
render  the  mission  worthless;  for  example,  objects  of  interest  may  move  out  of  the  target 
area  without  them  being  detected.  There  could  be  several  unforeseen  events  that  could 
prevent  continuous  coverage  and  if  it  is  the  case  then  one  needs  to  obtain  the  maximum 
coverage  possible. 

A  new  mathematical  framework  was  needed  to  solve  the  problem.  We  developed  the 
framework  from  scratch  since  no  previous  work  was  done  on  such  a  problem.  It  will 
serve  as  a  baseline  model  for  more  complex  UAV  scheduling  problems.  We  introduced 
the  notion  of  a  UAV  cyclic  schedule  and  in  the  case  of  a  homogeneous  UAV  fleet  we 
derive  a  formula  for  the  minimum  of  UAVs  needed  to  ensure  continuous  coverage.  For 
a  non-homogeneous  UAV  fleet  we  fonnulate  the  problem  as  a  binary  integer  program 
and  solved  it.  We  built  an  Excel  tool  based  on  the  findings.  Taking  a  fleet  of  MQ-l’s, 
MQ-9’s  and  Global  Hawk’s  we  used  the  tool  to  come  up  with  the  optimal  UAV  cyclic 
schedule  that  provides  continuous  coverage. 

Several  key  insights  were  obtained.  The  model  provides  valuable  information  on  the 
parameters  driving  the  UAV  performance  coverage.  Loitering  and  transit  times  are  the 
most  impacting  parameters  driving  the  performance  coverage  of  the  UAVs  and  the 
needed  number  of  UAVs  goes  up  as  the  transit  time  goes  up.  Also,  the  number  of  needed 
UAVs  goes  down  as  the  loitering  time  goes  up.  A  new  UAV  productivity  metric  is 
introduced  as  the  ratio  of  the  loitering  to  the  transit  time.  As  this  ratio  goes  up  a  smaller 
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number  of  UAVs  are  required  to  provide  continuous  coverage  because  they  are  more 
productive.  The  results  obtained  can  be  applied  to  other  surveillance  problems  and 
particularly  those  pertinent  to  NRO  and  NSA. 

The  developed  mathematical  model  can  be  used  to  solve  other  problems  sharing  the  same 
structure  as  the  UAV  continuous  coverage  problem.  The  model  that  we  developed  can 
be  applied  to  other  situations  where  a  task  is  to  be  processed  continuously  without 
interruptions  and  the  “agents”  providing  the  resources  to  perfonn  the  task  are  scheduled 
cyclically.  Each  agent  carries  out  a  portion  of  the  task  before  handing  it  over  to  the  next 
one.  Here  the  agent  is  limited  in  its  capability  to  work  for  a  long  time  without  interruption 
because  it  needs  resources  to  sustain  itself  while  working  and  so  needs  to  break  away 
from  the  task  while  another  agent  takes  over.  Only  one  agent  can  work  on  the  task  at  a 
time.  Search  and  rescue  missions  where  continuous  coverage  may  be  crucial  to  find 
survivors,  aerial  tankers  needing  to  orbit  while  waiting  to  refuel  aircraft,  satellite  orbiting 
to  provide  a  continuous  flow  of  infonnation  may  be  modeled  using  the  obtained  results. 

UAV  continuous  coverage  of  a  target  is  crucial  for  the  success  of  a  critical  ISR  mission. 
Finding  the  minimum  number  of  UAVs  required  and  an  optimal  cyclic  schedule  to  ensure 
continuous  coverage  will  enhance  the  asymmetric  warfare  capabilities  of  the  Air  Force. 
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UAV  Continuous  Coverage  Problem 


Appendix  B.  Poster  Chart 
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Appendix  C.  Excel  Model  User  Guide 


The  software  implementation  is  in  the  form  of  a  Microsoftr  Office  Excelr  spread-sheet 


Microsoftr  Corporation  (2006).  First  we  calculate  the  loitering  and  roundtrip  times  using 
the  endurance-time  and  distance  to  the  target  data  and  then  we  build  the  linear 
programming  model  to  be  solved  using  Excelr  Solver. 


Step  1.  Data  Setting 


The  loitering  and  roundtrip  times  are  calculated  using  the  UAV  endurance  time,  cruise 
speed,  and  distance  data. 


endurance 

speed 

X 

MQ-l 

24 

92 

mile/h 

Refueling  and  Maintenance  time 

5  hours 

MQ-9 

24 

183 

mile/h 

Distance  to  Target  Area 

1100  mile 

1770.3  km 

RQ-4 

42 

404 

mile/h 

41  42  43  A  T 

MQ-l  11.957  11.957  5  28.913  0.087 

MQ-9  6.011  6.011  5  17.022  11.978 

RQ-4  2.723  2.723  5  10.446  36.554 

Figure  27.  Basic  Data  Setting  Spread  Sheet 


Step  2.  Linear  Programming  Model  Setting 


Using  the  data  calculated  from  step  1  we  build  the  linear  program  model  to  solve  using 
Excelr  Solver. 


=  Sumproduct(B3:U3,  B4:U4) 


77 


\  A 

B 

c 

D 

E 

F 

G 

H 

1 

J 

K 

L 

M 

N 

0 

P 

Q 

R 

s 

T 

U 

V 

W 

1 

MQ-1  Predator 

MQ-9  Reaper 

RQ-4 Global  Hawk 

2 

decision  varables 

xl 

x2 

x3 

x4 

x5 

x6 

x7 

x8 
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1 
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solution 
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0 
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0 

0 
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0 
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0 
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0 

0 

0 

5 

constraints. 

Matrix  A 

vector  b 

6 

1 

\o 
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11.978 
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11.978 
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0.087 

0.087 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

36.554 

36.554 

36.554 

36.554 

73.109 

28.913 

8 

3 

0.087 

\u)87 

0 

0.087 

0.087 

0.087 

0.087 

0.087 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

36.554 

36.554 

36.554 

36.554 

73.109 

28.913 

9 

4 

0.087 

0.0&7 

0.087 

0 

0.087 

0.087 

0.087 

0.087 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

36.554 

36.554 

36.554 

36.554 

73.109 

28.913 

10 

5 

0.087 

0.087N 

SQ.087 

0.087 

0 

0.087 

0.087 

0.087 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

36.554 

36.554 

36.554 

36.554 

73.109 

28.913 

11 

6 

0.087 

0.087 

0^7 

0.087 

0.087 

0 

0.087 

0.087 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

36.554 

36.554 

36.554 

36.554 

73.109 

28.913 

12 

7 

0.087 

0.087 

0.087s 

vO.087 

0.087 

0.087 

0 

0.087 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

36.554 

36.554 

36.554 

36.554 

73.109 

28.913 

13 

8 

0.087 

0.087 

0.087 

Nj87 

0.087 

0.087 

0.087 

0 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

36.554 

36.554 

36.554 

36.554 

73.109 

28.913 

14 

9 

0.087 

0.087 

0.087 

o.ojN, 

0.087 

0.087 

0.087 

0.087 

0 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

36.554 

36.554 

36.554 

36.554 

73.109 

17.022 

15 

10 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

11.978 

0 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

36.554 

36.554 

36.554 

36.554 

73.109 

17.022 

16 

11 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

11.978 

11.978 

0 

11.978 

11.978 

11.978 

11.978 

11.978 

36.554 

36.554 

36.554 

36.554 

73.109 

17.022 

17 

12 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

11.978 

11.978 

11.978 

0 

11.978 

11.978 

11.978 

11.978 

36.554 

36.554 

36.554 

36.554 

73.109 

17.022 

18 

13 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

11.978 

11.978 

11.978 

11.978 

0 

11.978 

11.978 

11.978 

36.554 

36.554 

36.554 

36.554 

73.109 

17.022 

19 

14 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

11.978 

11.978 

11.978 

11.978 

11.978 

0 

11.978 

11.978 

36.554 

36.554 

36.554 

36.554 

73.109 

17.022 

20 

15 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

0 

11.978 

36.554 

36.554 

36.554 

36.554 

73.109 

17.022 

21 

16 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

0 

36.554 

36.554 

36.554 

36.554 

73.109 

17.022 

22 

17 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

0 

36.554 

36.554 

36.554 

36.554 

10.446 

23 

18 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

36.554 

0 

36.554 

36.554 

36.554 

10.446 

24 

19 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

36.554 

36.554 

0 

36.554 

73.109 

10.446 

25 

20 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

0.087 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

11.978 

36.554 

36.554 

36.554 

0 

x  73.109 

10.446 

Sumproduct($B$3:$U$3,  B25:U25) 


Figure  28.  Screen  Shot  of  Excel  Spread-sheet 

Decision  variables  :  A  binary  variable  indicates  whether  or  not  a  UAV  is  a  part  of  cyclic 
schedule. 


Coefficients  :  Each  decision  variable  has  a  coefficient  1  in  the  objective  function. 
Solution  :  Optimal  solution  vector  x*  —  (x^,  x\,  x|0) 

Matrix  A  :  Entries  of  ^4  are  all  UAV  loitering  times  with  the  main  diagonal  entries  being 
zero. 

Vector  b  :  Each  entry  of  b  is  a  UAV  roundtrip. 


Step  3.  Add-in  Excel r  Solver 

1 .  Click  the  Microsoft  Office  Button  ,  and  then  click  Excel  Options. 

2.  Click  Add-Ins,  and  then  in  the  Manage  box,  select  Excel  Add-ins. 
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3.  Click  Go. 


4.  In  the  Add-Ins  available  box,  select  the  Solver  Add-in  check  box,  and  then 
click  OK. 

5.  After  you  load  the  Solver  Add-in,  the  Solver  command  is  available  in  the 
Analysis  group  on  the  Data  tab. 


Step  3.  Formulating  Linear  Program 


Figure  29.  Solver  Parameters 
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